Nagios Support Forum

Linux Distribution and version?
1. Cent OS 6.2 / 64 Bit
2. Manual Install
3. Gnome installed

To Nagios XI Tech Support Specialist:
scottwilkerson has assisted us on 3 Jan 2013. The remote session resolved our db connection failure issue. However, I am no longer able to open a graph for each host node. How can I fix this?

Can we verify that npcd is running and if not

To scottwilkerson:
The npcd commands did not solve our graph issue. I checked numerous times, and the graphs are still not showing up for our hosts nodes.

Are you able to see the graphs but they are blank, or is the entire page empty?

Can you run the following and report it back:

Last login: Sun Jan 6 04:43:37 2013 from 2ncssw212.uhi.amerco
[root@fldmon ~]# tail -f /var/log/httpd/error_log
[Sun Jan 06 04:02:30 2013] [notice] Digest: generating secret for digest authentication ...
[Sun Jan 06 04:02:30 2013] [notice] Digest: done
[Sun Jan 06 04:02:30 2013] [notice] Apache/2.2.3 (CentOS) configured -- resuming normal operations
[Sun Jan 06 04:43:51 2013] [notice] caught SIGTERM, shutting down
[Sun Jan 06 04:47:13 2013] [notice] suEXEC mechanism enabled (wrapper: /usr/sbin/suexec)
[Sun Jan 06 04:47:13 2013] [notice] Digest: generating secret for digest authentication ...
[Sun Jan 06 04:47:13 2013] [notice] Digest: done
[Sun Jan 06 04:47:15 2013] [notice] Apache/2.2.3 (CentOS) configured -- resuming normal operations

Can you share the results from the other two logs as well? You may have missed my edit to the previous message.

[root@fldmon ~]# tail -f /var/log/httpd/error_log
[Sun Jan 06 04:02:30 2013] [notice] Digest: generating secret for digest authentication ...
[Sun Jan 06 04:02:30 2013] [notice] Digest: done
[Sun Jan 06 04:02:30 2013] [notice] Apache/2.2.3 (CentOS) configured -- resuming normal operations
[Sun Jan 06 04:43:51 2013] [notice] caught SIGTERM, shutting down
[Sun Jan 06 04:47:13 2013] [notice] suEXEC mechanism enabled (wrapper: /usr/sbin/suexec)
[Sun Jan 06 04:47:13 2013] [notice] Digest: generating secret for digest authentication ...
[Sun Jan 06 04:47:13 2013] [notice] Digest: done
[Sun Jan 06 04:47:15 2013] [notice] Apache/2.2.3 (CentOS) configured -- resuming normal operations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------
[root@fldmon ~]# tail -f /usr/local/nagios/var/npcd.log
[01-04-2013 12:42:25] NPCD: HINT: load_threshold is enabled - ('10.000000')
[01-05-2013 00:11:00] NPCD: WARN: MAX load reached: load 17.650000/10.000000 at i=0[01-05-2013 00:11:15] NPCD: WARN: MAX load reached: load 14.240000/10.000000 at i=1[01-05-2013 00:11:30] NPCD: WARN: MAX load reached: load 11.430000/10.000000 at i=1[01-05-2013 00:21:15] NPCD: WARN: MAX load reached: load 13.020000/10.000000 at i=0[01-05-2013 00:21:30] NPCD: WARN: MAX load reached: load 10.220000/10.000000 at i=1[01-05-2013 00:55:31] NPCD: WARN: MAX load reached: load 10.810000/10.000000 at i=0[01-05-2013 00:56:31] NPCD: WARN: MAX load reached: load 10.510000/10.000000 at i=0[01-05-2013 02:51:01] NPCD: WARN: MAX load reached: load 14.910000/10.000000 at i=0[01-05-2013 02:51:16] NPCD: WARN: MAX load reached: load 12.300000/10.000000 at i=1[01-05-2013 02:51:31] NPCD: WARN: MAX load reached: load 10.200000/10.000000 at i=1[01-05-2013 03:15:31] NPCD: WARN: MAX load reached: load 11.360000/10.000000 at i=0[01-05-2013 04:32:02] NPCD: WARN: MAX load reached: load 16.440000/10.000000 at i=0[01-05-2013 04:32:17] NPCD: WARN: MAX load reached: load 13.590000/10.000000 at i=1[01-05-2013 04:32:32] NPCD: WARN: MAX load reached: load 10.580000/10.000000 at i=1[01-05-2013 07:00:18] NPCD: WARN: MAX load reached: load 15.140000/10.000000 at i=0[01-05-2013 07:00:33] NPCD: WARN: MAX load reached: load 13.470000/10.000000 at i=1[01-05-2013 07:00:48] NPCD: WARN: MAX load reached: load 13.330000/10.000000 at i=1[01-05-2013 07:01:03] NPCD: WARN: MAX load reached: load 12.780000/10.000000 at i=1[01-05-2013 07:01:20] NPCD: WARN: MAX load reached: load 12.210000/10.000000 at i=1[01-05-2013 07:01:35] NPCD: WARN: MAX load reached: load 11.520000/10.000000 at i=1[01-05-2013 07:01:50] NPCD: WARN: MAX load reached: load 10.110000/10.000000 at i=1[01-05-2013 09:02:06] NPCD: WARN: MAX load reached: load 10.180000/10.000000 at i=0[01-05-2013 10:27:37] NPCD: WARN: MAX load reached: load 12.610000/10.000000 at i=0[01-05-2013 10:27:52] NPCD: WARN: MAX load reached: load 10.880000/10.000000 at i=1[01-05-2013 11:23:22] NPCD: WARN: MAX load reached: load 11.330000/10.000000 at i=0[01-05-2013 13:21:08] NPCD: WARN: MAX load reached: load 13.610000/10.000000 at i=0[01-05-2013 13:21:23] NPCD: WARN: MAX load reached: load 10.910000/10.000000 at i=1[01-05-2013 14:55:23] NPCD: WARN: MAX load reached: load 11.360000/10.000000 at i=0[01-05-2013 14:55:38] NPCD: WARN: MAX load reached: load 10.160000/10.000000 at i=1[01-05-2013 18:04:09] NPCD: WARN: MAX load reached: load 13.860000/10.000000 at i=0[01-05-2013 18:04:24] NPCD: WARN: MAX load reached: load 11.890000/10.000000 at i=1[01-05-2013 18:06:24] NPCD: WARN: MAX load reached: load 10.750000/10.000000 at i=0[01-05-2013 18:07:09] NPCD: WARN: MAX load reached: load 10.920000/10.000000 at i=0[01-06-2013 00:25:13] NPCD: WARN: MAX load reached: load 16.440000/10.000000 at i=0[01-06-2013 00:25:28] NPCD: WARN: MAX load reached: load 14.090000/10.000000 at i=1[01-06-2013 00:25:43] NPCD: WARN: MAX load reached: load 12.220000/10.000000 at i=1[01-06-2013 02:21:43] NPCD: WARN: MAX load reached: load 12.270000/10.000000 at i=0[01-06-2013 02:31:44] NPCD: WARN: MAX load reached: load 14.210000/10.000000 at i=0[01-06-2013 02:31:59] NPCD: WARN: MAX load reached: load 11.220000/10.000000 at i=1[01-06-2013 02:32:14] NPCD: WARN: MAX load reached: load 10.940000/10.000000 at i=1[01-06-2013 04:44:05] NPCD: Caught Termination Signal - Hasta la vista... baby
[01-06-2013 04:47:13] NPCD: npcd Daemon (0.4.14) started with PID=4034
[01-06-2013 04:47:13] NPCD: Please have a look at 'npcd -V' to get license information
[01-06-2013 04:47:13] NPCD: HINT: load_threshold is enabled - ('10.000000')
[01-06-2013 04:52:08] NPCD: Caught Termination Signal - Hasta la vista... baby
[01-06-2013 04:52:08] NPCD: npcd Daemon (0.4.14) started with PID=12752
[01-06-2013 04:52:08] NPCD: Please have a look at 'npcd -V' to get license information
[01-06-2013 04:52:08] NPCD: HINT: load_threshold is enabled - ('10.000000')
[01-06-2013 08:06:09] NPCD: WARN: MAX load reached: load 11.230000/10.000000 at i=0[01-06-2013 10:41:10] NPCD: WARN: MAX load reached: load 14.660000/10.000000 at i=0[01-06-2013 10:41:25] NPCD: WARN: MAX load reached: load 12.930000/10.000000 at i=1[01-06-2013 10:41:40] NPCD: WARN: MAX load reached: load 10.420000/10.000000 at i=1[01-06-2013 11:06:55] NPCD: WARN: MAX load reached: load 14.160000/10.000000 at i=0[01-06-2013 11:07:10] NPCD: WARN: MAX load reached: load 11.170000/10.000000 at i=1[01-06-2013 11:07:25] NPCD: WARN: MAX load reached: load 10.110000/10.000000 at i=1[01-06-2013 11:08:25] NPCD: WARN: MAX load reached: load 10.270000/10.000000 at i=0[01-06-2013 11:09:25] NPCD: WARN: MAX load reached: load 11.660000/10.000000 at i=0[01-06-2013 12:07:25] NPCD: WARN: MAX load reached: load 10.290000/10.000000 at i=0[01-06-2013 12:10:25] NPCD: WARN: MAX load reached: load 11.540000/10.000000 at i=0[01-06-2013 12:10:40] NPCD: WARN: MAX load reached: load 10.730000/10.000000 at i=1[01-06-2013 14:24:44] NPCD: WARN: MAX load reached: load 10.800000/10.000000 at i=0[01-06-2013 15:49:44] NPCD: WARN: MAX load reached: load 10.280000/10.000000 at i=0[01-06-2013 18:26:31] NPCD: WARN: MAX load reached: load 15.540000/10.000000 at i=0[01-06-2013 18:26:46] NPCD: WARN: MAX load reached: load 12.610000/10.000000 at i=1[01-06-2013 18:27:01] NPCD: WARN: MAX load reached: load 10.020000/10.000000 at i=1[01-06-2013 23:20:48] NPCD: WARN: MAX load reached: load 11.650000/10.000000 at i=0[01-07-2013 06:48:50] NPCD: WARN: MAX load reached: load 11.400000/10.000000 at i=0[01-07-2013 07:00:20] NPCD: WARN: MAX load reached: load 11.130000/10.000000 at i=0[01-07-2013 07:00:35] NPCD: WARN: MAX load reached: load 11.150000/10.000000 at i=1[01-07-2013 07:00:50] NPCD: WARN: MAX load reached: load 10.360000/10.000000 at i=1[01-07-2013 07:01:24] NPCD: WARN: MAX load reached: load 10.600000/10.000000 at i=0[01-07-2013 07:01:39] NPCD: WARN: MAX load reached: load 10.960000/10.000000 at i=1[01-07-2013 07:01:54] NPCD: WARN: MAX load reached: load 10.410000/10.000000 at i=1[01-07-2013 08:35:40] NPCD: WARN: MAX load reached: load 10.690000/10.000000 at i=0[01-07-2013 08:55:55] NPCD: WARN: MAX load reached: load 11.790000/10.000000 at i=0[01-07-2013 09:03:55] NPCD: WARN: MAX load reached: load 10.630000/10.000000 at i=0[01-07-2013 09:04:55] NPCD: WARN: MAX load reached: load 19.090000/10.000000 at i=0[01-07-2013 09:05:10] NPCD: WARN: MAX load reached: load 15.340000/10.000000 at i=1[01-07-2013 09:05:25] NPCD: WARN: MAX load reached: load 12.330000/10.000000 at i=1[01-07-2013 09:05:40] NPCD: WARN: MAX load reached: load 10.310000/10.000000 at i=1[01-07-2013 09:05:55] NPCD: WARN: MAX load reached: load 12.010000/10.000000 at i=1[01-07-2013 09:06:10] NPCD: WARN: MAX load reached: load 10.740000/10.000000 at i=1[01-07-2013 10:06:57] NPCD: WARN: MAX load reached: load 14.000000/10.000000 at i=0[01-07-2013 10:07:12] NPCD: WARN: MAX load reached: load 11.180000/10.000000 at i=1[01-07-2013 11:27:42] NPCD: WARN: MAX load reached: load 10.490000/10.000000 at i=0[01-07-2013 14:17:58] NPCD: WARN: MAX load reached: load 15.220000/10.000000 at i=0[01-07-2013 14:18:13] NPCD: WARN: MAX load reached: load 12.210000/10.000000 at i=1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------
[root@fldmon ~]# tail -f /usr/local/nagios/var/perfdata.log
2012-12-20 12:01:24 [6180] [0] *** TIMEOUT: Please check your npcd.cfg
2012-12-20 12:01:24 [6180] [0] *** TIMEOUT: /usr/local/nagios/var/spool/perfdata//1356030064.perfdata.host-PID-6180 deleted
2012-12-20 12:01:24 [6180] [0] *** Timeout while processing Host: "884000_MCO741" Service: "_HOST_"
2012-12-20 12:01:24 [6180] [0] *** process_perfdata.pl terminated on signal ALRM
2012-12-20 12:01:24 [6178] [0] *** TIMEOUT: Timeout after 5 secs. ***
2012-12-20 12:01:24 [6178] [0] *** TIMEOUT: Deleting current file to avoid NPCD loops
2012-12-20 12:01:24 [6178] [0] *** TIMEOUT: Please check your npcd.cfg
2012-12-20 12:01:24 [6178] [0] *** TIMEOUT: /usr/local/nagios/var/spool/perfdata//1356030049.perfdata.host-PID-6178 deleted
2012-12-20 12:01:24 [6178] [0] *** Timeout while processing Host: "751058" Service: "_HOST_"
2012-12-20 12:01:24 [6178] [0] *** process_perfdata.pl terminated on signal ALRM

NPCD is hitting its max load threshold.

Edit /usr/local/nagios/etc/pnp/npcd.cfg and increase the "load_threshold" value to "20.0" (line 136).

You may want to increase the timeout as well:

Edit /usr/local.nagios/etc/pnp/process_perfdata.cfg and increase the "TIMEOUT" value to "10" (line 8).

Restart NPCD:

This looks like it is being limited by the load_threshold in /usr/local/nagios/etc/pnp/npcd.cfg
How many CPU's do you have on your XI system?

There are 8 cpus, sitting mostly idle.
Cpu(s): 3.4%us, 5.7%sy, 0.0%ni, 89.7%id, 0.0%wa, 0.0%hi, 1.2%si, 0.0%st

After updating npcd.cfg to a value of "20.0" and the timeout value "10.0"

[root@fldmon ~]# tail /usr/local/nagios/var/npcd.log
[01-06-2013 04:52:08] NPCD: Please have a look at 'npcd -V' to get license information
[01-06-2013 04:52:08] NPCD: HINT: load_threshold is enabled - ('10.000000')
[01-06-2013 08:06:09] NPCD: WARN: MAX load reached: load 11.230000/10.000000 at i=0[01-06-2013 10:41:10] NPCD: WARN: MAX load reached: load 14.660000/10.000000 at i=0[01-06-2013 10:41:25] NPCD: WARN: MAX load reached: load 12.930000/10.000000 at i=1[01-06-2013 10:41:40] NPCD: WARN: MAX load reached: load 10.420000/10.000000 at i=1[01-06-2013 11:06:55] NPCD: WARN: MAX load reached: load 14.160000/10.000000 at i=0[01-06-2013 11:07:10] NPCD: WARN: MAX load reached: load 11.170000/10.000000 at i=1[01-06-2013 11:07:25] NPCD: WARN: MAX load reached: load 10.110000/10.000000 at i=1[01-06-2013 11:08:25] NPCD: WARN: MAX load reached: load 10.270000/10.000000 at i=0[01-06-2013 11:09:25] NPCD: WARN: MAX load reached: load 11.660000/10.000000 at i=0[01-06-2013 12:07:25] NPCD: WARN: MAX load reached: load 10.290000/10.000000 at i=0[01-06-2013 12:10:25] NPCD: WARN: MAX load reached: load 11.540000/10.000000 at i=0[01-06-2013 12:10:40] NPCD: WARN: MAX load reached: load 10.730000/10.000000 at i=1[01-06-2013 14:24:44] NPCD: WARN: MAX load reached: load 10.800000/10.000000 at i=0[01-06-2013 15:49:44] NPCD: WARN: MAX load reached: load 10.280000/10.000000 at i=0[01-06-2013 18:26:31] NPCD: WARN: MAX load reached: load 15.540000/10.000000 at i=0[01-06-2013 18:26:46] NPCD: WARN: MAX load reached: load 12.610000/10.000000 at i=1[01-06-2013 18:27:01] NPCD: WARN: MAX load reached: load 10.020000/10.000000 at i=1[01-06-2013 23:20:48] NPCD: WARN: MAX load reached: load 11.650000/10.000000 at i=0[01-07-2013 06:48:50] NPCD: WARN: MAX load reached: load 11.400000/10.000000 at i=0[01-07-2013 07:00:20] NPCD: WARN: MAX load reached: load 11.130000/10.000000 at i=0[01-07-2013 07:00:35] NPCD: WARN: MAX load reached: load 11.150000/10.000000 at i=1[01-07-2013 07:00:50] NPCD: WARN: MAX load reached: load 10.360000/10.000000 at i=1[01-07-2013 07:01:24] NPCD: WARN: MAX load reached: load 10.600000/10.000000 at i=0[01-07-2013 07:01:39] NPCD: WARN: MAX load reached: load 10.960000/10.000000 at i=1[01-07-2013 07:01:54] NPCD: WARN: MAX load reached: load 10.410000/10.000000 at i=1[01-07-2013 08:35:40] NPCD: WARN: MAX load reached: load 10.690000/10.000000 at i=0[01-07-2013 08:55:55] NPCD: WARN: MAX load reached: load 11.790000/10.000000 at i=0[01-07-2013 09:03:55] NPCD: WARN: MAX load reached: load 10.630000/10.000000 at i=0[01-07-2013 09:04:55] NPCD: WARN: MAX load reached: load 19.090000/10.000000 at i=0[01-07-2013 09:05:10] NPCD: WARN: MAX load reached: load 15.340000/10.000000 at i=1[01-07-2013 09:05:25] NPCD: WARN: MAX load reached: load 12.330000/10.000000 at i=1[01-07-2013 09:05:40] NPCD: WARN: MAX load reached: load 10.310000/10.000000 at i=1[01-07-2013 09:05:55] NPCD: WARN: MAX load reached: load 12.010000/10.000000 at i=1[01-07-2013 09:06:10] NPCD: WARN: MAX load reached: load 10.740000/10.000000 at i=1[01-07-2013 10:06:57] NPCD: WARN: MAX load reached: load 14.000000/10.000000 at i=0[01-07-2013 10:07:12] NPCD: WARN: MAX load reached: load 11.180000/10.000000 at i=1[01-07-2013 11:27:42] NPCD: WARN: MAX load reached: load 10.490000/10.000000 at i=0[01-07-2013 14:17:58] NPCD: WARN: MAX load reached: load 15.220000/10.000000 at i=0[01-07-2013 14:18:13] NPCD: WARN: MAX load reached: load 12.210000/10.000000 at i=1[01-07-2013 16:34:29] NPCD: WARN: MAX load reached: load 10.100000/10.000000 at i=0[01-07-2013 19:02:00] NPCD: WARN: MAX load reached: load 10.050000/10.000000 at i=0[01-08-2013 09:20:09] NPCD: WARN: MAX load reached: load 10.910000/10.000000 at i=0[01-08-2013 09:23:24] NPCD: WARN: MAX load reached: load 20.690000/10.000000 at i=0[01-08-2013 09:23:39] NPCD: WARN: MAX load reached: load 16.270000/10.000000 at i=1[01-08-2013 09:23:54] NPCD: WARN: MAX load reached: load 12.940000/10.000000 at i=1[01-08-2013 09:24:09] NPCD: WARN: MAX load reached: load 11.000000/10.000000 at i=1[01-08-2013 09:32:39] NPCD: WARN: MAX load reached: load 10.670000/10.000000 at i=0[01-08-2013 09:53:10] NPCD: WARN: MAX load reached: load 11.590000/10.000000 at i=0[01-08-2013 10:13:11] NPCD: Caught Termination Signal - Hasta la vista... baby
[01-08-2013 10:13:11] NPCD: npcd Daemon (0.4.14) started with PID=16091
[01-08-2013 10:13:11] NPCD: Please have a look at 'npcd -V' to get license information
[01-08-2013 10:13:11] NPCD: HINT: load_threshold is enabled - ('20.000000')
[01-08-2013 10:43:26] NPCD: WARN: MAX load reached: load 28.120000/20.000000 at i=0[01-08-2013 10:43:41] NPCD: WARN: MAX load reached: load 23.970000/20.000000 at i=1[01-08-2013 10:43:56] NPCD: WARN: MAX load reached: load 20.810000/20.000000 at i=1[01-08-2013 10:44:12] NPCD: WARN: MAX load reached: load 30.670000/20.000000 at i=1[01-08-2013 10:44:27] NPCD: WARN: MAX load reached: load 25.330000/20.000000 at i=1[01-08-2013 10:44:42] NPCD: WARN: MAX load reached: load 25.980000/20.000000 at i=1[01-08-2013 10:44:57] NPCD: WARN: MAX load reached: load 23.900000/20.000000 at i=1[01-08-2013 10:45:12] NPCD: WARN: MAX load reached: load 21.750000/20.000000 at i=1[01-08-2013 10:45:57] NPCD: WARN: MAX load reached: load 25.740000/20.000000 at i=0[01-08-2013 10:46:12] NPCD: WARN: MAX load reached: load 21.390000/20.000000 at i=1[01-08-2013 10:49:58] NPCD: WARN: MAX load reached: load 26.930000/20.000000 at i=0[01-08-2013 10:50:13] NPCD: WARN: MAX load reached: load 29.970000/20.000000 at i=1[01-08-2013 10:50:28] NPCD: WARN: MAX load reached: load 24.290000/20.000000 at i=1[01-08-2013 10:50:45] NPCD: WARN: MAX load reached: load 24.860000/20.000000 at i=1[01-08-2013 10:51:00] NPCD: WARN: MAX load reached: load 28.440000/20.000000 at i=1[01-08-2013 10:51:15] NPCD: WARN: MAX load reached: load 25.900000/20.000000 at i=1[01-08-2013 10:51:30] NPCD: WARN: MAX load reached: load 26.180000/20.000000 at i=1[01-08-2013 10:51:45] NPCD: WARN: MAX load reached: load 24.620000/20.000000 at i=1[01-08-2013 10:52:00] NPCD: WARN: MAX load reached: load 23.830000/20.000000 at i=1[01-08-2013 10:52:15] NPCD: WARN: MAX load reached: load 22.920000/20.000000 at i=1[01-08-2013 10:52:45] NPCD: WARN: MAX load reached: load 20.770000/20.000000 at i=0[01-08-2013 10:53:00] NPCD: WARN: MAX load reached: load 23.440000/20.000000 at i=1[01-08-2013 10:55:15] NPCD: WARN: MAX load reached: load 20.800000/20.000000 at i=0[01-08-2013 11:12:54] NPCD: Caught Termination Signal - Hasta la vista... baby
[01-08-2013 11:12:54] NPCD: npcd Daemon (0.4.14) started with PID=27856
[01-08-2013 11:12:54] NPCD: Please have a look at 'npcd -V' to get license information
[01-08-2013 11:12:54] NPCD: HINT: load_threshold is enabled - ('20.000000')


Looks like it is reaching the max load??