Dear support,
we are running Nagios XI 2012R1.3 in distributed environment ( mod_gearman ) and mysql offloaded. ( OS - centos 6 64-bit )
we are having issue with all bandwidth usage graphs it was updated all of sudden we have noticed frequent gaps coming kindly check attached file for more details.
awaiting your prompt response.
Regards..
gaps in all bandwidth graphs
-
- Posts: 616
- Joined: Tue Oct 16, 2012 12:28 am
gaps in all bandwidth graphs
You do not have the required permissions to view the files attached to this post.
Zajil NMS
-
- Red Shirt
- Posts: 8334
- Joined: Thu Nov 15, 2012 1:20 pm
Re: gaps in all bandwidth graphs
Any errors or warnings in:
/usr/local/nagios/var/perfdata.log
or
/usr/local/nagios/var/npcd.log
or your gearman log?
/usr/local/nagios/var/perfdata.log
or
/usr/local/nagios/var/npcd.log
or your gearman log?
Former Nagios employee
"It is turtles. All. The. Way. Down. . . .and maybe an elephant or two."
VI VI VI - The editor of the Beast!
Come to the Dark Side.
"It is turtles. All. The. Way. Down. . . .and maybe an elephant or two."
VI VI VI - The editor of the Beast!
Come to the Dark Side.
-
- Posts: 616
- Joined: Tue Oct 16, 2012 12:28 am
Re: gaps in all bandwidth graphs
check the attached log files.. at presebt all jobs are performed by slave.
You do not have the required permissions to view the files attached to this post.
Zajil NMS
-
- DevOps Engineer
- Posts: 19396
- Joined: Tue Nov 15, 2011 3:11 pm
- Location: Nagios Enterprises
Re: gaps in all bandwidth graphs
It looks like you may have rrdcached setup incorrectly. In /usr/local/nagios/etc/pnp/process_perfdata.cfg you should have
Also, can you post the result of the following without grepping for anything
Code: Select all
RRD_DAEMON_OPTS = unix:/var/rrdtool/rrdcached/rrdcached.sock
Code: Select all
tail -n 40 /usr/local/nagios/var/perfdata.log
-
- Posts: 616
- Joined: Tue Oct 16, 2012 12:28 am
Re: gaps in all bandwidth graphs
Hi Scott,
We do have the Line in /usr/local/nagios/etc/pnp/process_perfdata.cfg, the output on the log below. Only in Bandwith graph the output in/out is 0 and sometimes with Value.
2012-12-27 08:40:33 [29390] [1] Found Performance Data for nuz-3750-1 / 0505_nuz_3750_1_1_0_24_nuz_7200_1_0_1_FE_RJ45_XX_Bandwidth (in=0Mb/s;75;90 out=0Mb/s;75;90)
2012-12-27 08:40:33 [29390] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/nuz-3750-1/0505_nuz_3750_1_1_0_24_nuz_7200_1_0_1_FE_RJ45_XX_Bandwidth.rrd 1356586824:0:0
2012-12-27 08:40:33 [29390] [2] /usr/local/nagios/share/perfdata/nuz-3750-1/0505_nuz_3750_1_1_0_24_nuz_7200_1_0_1_FE_RJ45_XX_Bandwidth.rrd updated
2012-12-27 08:40:33 [29390] [1] Found Performance Data for hwl-3750-1 / 0606_hwl_3750_1_1_0_14_hwl_malc_1_1_1_1_0_FE_RJ45_XX_Bandwidth (in=0Mb/s;75;90 out=0Mb/s;75;90)
We do have the Line in /usr/local/nagios/etc/pnp/process_perfdata.cfg, the output on the log below. Only in Bandwith graph the output in/out is 0 and sometimes with Value.
2012-12-27 08:40:33 [29390] [1] Found Performance Data for nuz-3750-1 / 0505_nuz_3750_1_1_0_24_nuz_7200_1_0_1_FE_RJ45_XX_Bandwidth (in=0Mb/s;75;90 out=0Mb/s;75;90)
2012-12-27 08:40:33 [29390] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/nuz-3750-1/0505_nuz_3750_1_1_0_24_nuz_7200_1_0_1_FE_RJ45_XX_Bandwidth.rrd 1356586824:0:0
2012-12-27 08:40:33 [29390] [2] /usr/local/nagios/share/perfdata/nuz-3750-1/0505_nuz_3750_1_1_0_24_nuz_7200_1_0_1_FE_RJ45_XX_Bandwidth.rrd updated
2012-12-27 08:40:33 [29390] [1] Found Performance Data for hwl-3750-1 / 0606_hwl_3750_1_1_0_14_hwl_malc_1_1_1_1_0_FE_RJ45_XX_Bandwidth (in=0Mb/s;75;90 out=0Mb/s;75;90)
Zajil NMS
-
- Posts: 616
- Joined: Tue Oct 16, 2012 12:28 am
Re: gaps in all bandwidth graphs
tail -n 40 /usr/local/pnp4nagios/var/perfdata.log
2012-12-27 08:47:07 [13738] [2] Processing Line 65
2012-12-27 08:47:07 [13739] [2] No Perfdata. Skipping line 91
2012-12-27 08:47:07 [13739] [2] Processing Line 92
2012-12-27 08:47:07 [13738] [2] Datatype set to 'HOSTPERFDATA'
2012-12-27 08:47:07 [13738] [1] Found Performance Data for egy-7200-1 / _HOST_ (rta=95.759003ms;150.000000;200.000000;0.000000 pl=0%;20;50;0)
2012-12-27 08:47:07 [13739] [2] Datatype set to 'SERVICEPERFDATA'
2012-12-27 08:47:07 [13739] [2] No Perfdata. Skipping line 92
2012-12-27 08:47:07 [13739] [2] Processing Line 93
2012-12-27 08:47:07 [13739] [2] Datatype set to 'SERVICEPERFDATA'
2012-12-27 08:47:07 [13739] [2] No Perfdata. Skipping line 93
2012-12-27 08:47:07 [13738] [2] data2rrd called
2012-12-27 08:47:07 [13739] [1] 93 lines processed
2012-12-27 08:47:07 [13739] [1] /usr/local/nagios/var/spool/perfdata/service-perfdata.1356587222-PID-13739 deleted
2012-12-27 08:47:07 [13738] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/egy-7200-1/_HOST_.rrd 1356587220:95.759003:0
2012-12-27 08:47:07 [13738] [2] /usr/local/nagios/share/perfdata/egy-7200-1/_HOST_.rrd updated
2012-12-27 08:47:07 [13738] [2] Processing Line 66
2012-12-27 08:47:07 [13738] [2] Datatype set to 'HOSTPERFDATA'
2012-12-27 08:47:07 [13738] [1] Found Performance Data for bgw-7200-1 / _HOST_ (rta=103.476997ms;150.000000;200.000000;0.000000 pl=0%;20;50;0)
2012-12-27 08:47:07 [13738] [2] data2rrd called
2012-12-27 08:47:07 [13739] [2] data2rrd called
2012-12-27 08:47:07 [13738] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/bgw-7200-1/_HOST_.rrd 1356587220:103.476997:0
2012-12-27 08:47:07 [13739] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/.pnp-internal/runtime_runtime.rrd 1356587212:0.643421
2012-12-27 08:47:07 [13739] [2] /usr/local/nagios/share/perfdata/.pnp-internal/runtime_runtime.rrd updated
2012-12-27 08:47:07 [13738] [2] /usr/local/nagios/share/perfdata/bgw-7200-1/_HOST_.rrd updated
2012-12-27 08:47:07 [13739] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/.pnp-internal/runtime_rows.rrd 1356587212:510
2012-12-27 08:47:07 [13738] [1] 66 lines processed
2012-12-27 08:47:07 [13738] [1] /usr/local/nagios/var/spool/perfdata/host-perfdata.1356587222-PID-13738 deleted
2012-12-27 08:47:07 [13739] [2] /usr/local/nagios/share/perfdata/.pnp-internal/runtime_rows.rrd updated
2012-12-27 08:47:07 [13738] [1] PNP exiting (runtime 0.076308s) ...
2012-12-27 08:47:07 [13739] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/.pnp-internal/runtime_errors.rrd 1356587212:24
2012-12-27 08:47:07 [13739] [2] /usr/local/nagios/share/perfdata/.pnp-internal/runtime_errors.rrd updated
2012-12-27 08:47:07 [13739] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/.pnp-internal/runtime_invalid.rrd 1356587212:0
2012-12-27 08:47:07 [13739] [2] /usr/local/nagios/share/perfdata/.pnp-internal/runtime_invalid.rrd updated
2012-12-27 08:47:07 [13739] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/.pnp-internal/runtime_skipped.rrd 1356587212:53
2012-12-27 08:47:07 [13739] [2] /usr/local/nagios/share/perfdata/.pnp-internal/runtime_skipped.rrd updated
2012-12-27 08:47:07 [13739] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/.pnp-internal/runtime_update.rrd 1356587212:433
2012-12-27 08:47:07 [13739] [2] /usr/local/nagios/share/perfdata/.pnp-internal/runtime_update.rrd updated
2012-12-27 08:47:07 [13739] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/.pnp-internal/runtime_create.rrd 1356587212:0
2012-12-27 08:47:07 [13739] [2] /usr/local/nagios/share/perfdata/.pnp-internal/runtime_create.rrd updated
2012-12-27 08:47:07 [13739] [1] PNP exiting (runtime 0.074569s) ...
2012-12-27 08:47:07 [13738] [2] Processing Line 65
2012-12-27 08:47:07 [13739] [2] No Perfdata. Skipping line 91
2012-12-27 08:47:07 [13739] [2] Processing Line 92
2012-12-27 08:47:07 [13738] [2] Datatype set to 'HOSTPERFDATA'
2012-12-27 08:47:07 [13738] [1] Found Performance Data for egy-7200-1 / _HOST_ (rta=95.759003ms;150.000000;200.000000;0.000000 pl=0%;20;50;0)
2012-12-27 08:47:07 [13739] [2] Datatype set to 'SERVICEPERFDATA'
2012-12-27 08:47:07 [13739] [2] No Perfdata. Skipping line 92
2012-12-27 08:47:07 [13739] [2] Processing Line 93
2012-12-27 08:47:07 [13739] [2] Datatype set to 'SERVICEPERFDATA'
2012-12-27 08:47:07 [13739] [2] No Perfdata. Skipping line 93
2012-12-27 08:47:07 [13738] [2] data2rrd called
2012-12-27 08:47:07 [13739] [1] 93 lines processed
2012-12-27 08:47:07 [13739] [1] /usr/local/nagios/var/spool/perfdata/service-perfdata.1356587222-PID-13739 deleted
2012-12-27 08:47:07 [13738] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/egy-7200-1/_HOST_.rrd 1356587220:95.759003:0
2012-12-27 08:47:07 [13738] [2] /usr/local/nagios/share/perfdata/egy-7200-1/_HOST_.rrd updated
2012-12-27 08:47:07 [13738] [2] Processing Line 66
2012-12-27 08:47:07 [13738] [2] Datatype set to 'HOSTPERFDATA'
2012-12-27 08:47:07 [13738] [1] Found Performance Data for bgw-7200-1 / _HOST_ (rta=103.476997ms;150.000000;200.000000;0.000000 pl=0%;20;50;0)
2012-12-27 08:47:07 [13738] [2] data2rrd called
2012-12-27 08:47:07 [13739] [2] data2rrd called
2012-12-27 08:47:07 [13738] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/bgw-7200-1/_HOST_.rrd 1356587220:103.476997:0
2012-12-27 08:47:07 [13739] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/.pnp-internal/runtime_runtime.rrd 1356587212:0.643421
2012-12-27 08:47:07 [13739] [2] /usr/local/nagios/share/perfdata/.pnp-internal/runtime_runtime.rrd updated
2012-12-27 08:47:07 [13738] [2] /usr/local/nagios/share/perfdata/bgw-7200-1/_HOST_.rrd updated
2012-12-27 08:47:07 [13739] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/.pnp-internal/runtime_rows.rrd 1356587212:510
2012-12-27 08:47:07 [13738] [1] 66 lines processed
2012-12-27 08:47:07 [13738] [1] /usr/local/nagios/var/spool/perfdata/host-perfdata.1356587222-PID-13738 deleted
2012-12-27 08:47:07 [13739] [2] /usr/local/nagios/share/perfdata/.pnp-internal/runtime_rows.rrd updated
2012-12-27 08:47:07 [13738] [1] PNP exiting (runtime 0.076308s) ...
2012-12-27 08:47:07 [13739] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/.pnp-internal/runtime_errors.rrd 1356587212:24
2012-12-27 08:47:07 [13739] [2] /usr/local/nagios/share/perfdata/.pnp-internal/runtime_errors.rrd updated
2012-12-27 08:47:07 [13739] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/.pnp-internal/runtime_invalid.rrd 1356587212:0
2012-12-27 08:47:07 [13739] [2] /usr/local/nagios/share/perfdata/.pnp-internal/runtime_invalid.rrd updated
2012-12-27 08:47:07 [13739] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/.pnp-internal/runtime_skipped.rrd 1356587212:53
2012-12-27 08:47:07 [13739] [2] /usr/local/nagios/share/perfdata/.pnp-internal/runtime_skipped.rrd updated
2012-12-27 08:47:07 [13739] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/.pnp-internal/runtime_update.rrd 1356587212:433
2012-12-27 08:47:07 [13739] [2] /usr/local/nagios/share/perfdata/.pnp-internal/runtime_update.rrd updated
2012-12-27 08:47:07 [13739] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/.pnp-internal/runtime_create.rrd 1356587212:0
2012-12-27 08:47:07 [13739] [2] /usr/local/nagios/share/perfdata/.pnp-internal/runtime_create.rrd updated
2012-12-27 08:47:07 [13739] [1] PNP exiting (runtime 0.074569s) ...
Zajil NMS
-
- Posts: 616
- Joined: Tue Oct 16, 2012 12:28 am
Re: gaps in all bandwidth graphs
Our NPCD.cfg and process_perfdata.cfg are being used from /usr/local/pnp4nagios/etc
2012-12-27 09:46:29 [20828] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/skb-3750-3/0202_skb_3750_3_1_0_11_skb_malc_2_1_1_1_0_FE_RJ45_XX_Bandwidth.rrd 1356590781:0:0
2012-12-27 09:46:29 [20828] [0] RRDs::update /usr/local/nagios/share/perfdata/skb-3750-3/0202_skb_3750_3_1_0_11_skb_malc_2_1_1_1_0_FE_RJ45_XX_Bandwidth.rrd 1356590781:0:0
2012-12-27 09:46:29 [20828] [0] RRDs::update ERROR rrdcached: illegal attempt to update using time 1356590781 when last update time is 1356590781 (minimum one second step)
2012-12-27 09:46:29 [20828] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/skb-3750-3/0202_skb_3750_3_1_0_11_skb_malc_2_1_1_1_0_FE_RJ45_XX_Bandwidth.rrd 1356590781:0:0
2012-12-27 09:46:29 [20828] [0] RRDs::update /usr/local/nagios/share/perfdata/skb-3750-3/0202_skb_3750_3_1_0_11_skb_malc_2_1_1_1_0_FE_RJ45_XX_Bandwidth.rrd 1356590781:0:0
2012-12-27 09:46:29 [20828] [0] RRDs::update ERROR rrdcached: illegal attempt to update using time 1356590781 when last update time is 1356590781 (minimum one second step)
Zajil NMS
-
- DevOps Engineer
- Posts: 19396
- Joined: Tue Nov 15, 2011 3:11 pm
- Location: Nagios Enterprises
Re: gaps in all bandwidth graphs
Did you install a different version of pnp4nagios than the one that came with Nagios XI? This could have very undesirable affe3cts that have not been tested by our team
-
- Posts: 616
- Joined: Tue Oct 16, 2012 12:28 am
-
- Posts: 7698
- Joined: Mon Apr 23, 2012 4:28 pm
- Location: Travelling through time and space...
Re: gaps in all bandwidth graphs
We just had another question about this yesterday:
There are a lot of cool features with the new version, and I am sure our dev's are looking into it.Xi actually uses a modified version of both PNP 0.4/0.6. The NPCD daemon and perfdata processing script are almost up to date to the latest version, while the front-end installed with XI is still 0.4. We haven't currently documented or tested the upgrade to the latest version, so at the moment we don't support it.