gaps in all bandwidth graphs

This support forum board is for support questions relating to Nagios XI, our flagship commercial network monitoring solution.
zaji_nms
Posts: 616
Joined: Tue Oct 16, 2012 12:28 am

gaps in all bandwidth graphs

Post by zaji_nms »

Dear support,

we are running Nagios XI 2012R1.3 in distributed environment ( mod_gearman ) and mysql offloaded. ( OS - centos 6 64-bit )

we are having issue with all bandwidth usage graphs it was updated all of sudden we have noticed frequent gaps coming kindly check attached file for more details.

awaiting your prompt response.

Regards..
You do not have the required permissions to view the files attached to this post.
Zajil NMS
abrist
Red Shirt
Posts: 8334
Joined: Thu Nov 15, 2012 1:20 pm

Re: gaps in all bandwidth graphs

Post by abrist »

Any errors or warnings in:

/usr/local/nagios/var/perfdata.log
or
/usr/local/nagios/var/npcd.log
or your gearman log?
Former Nagios employee
"It is turtles. All. The. Way. Down. . . .and maybe an elephant or two."
VI VI VI - The editor of the Beast!
Come to the Dark Side.
zaji_nms
Posts: 616
Joined: Tue Oct 16, 2012 12:28 am

Re: gaps in all bandwidth graphs

Post by zaji_nms »

check the attached log files.. at presebt all jobs are performed by slave.
You do not have the required permissions to view the files attached to this post.
Zajil NMS
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises

Re: gaps in all bandwidth graphs

Post by scottwilkerson »

It looks like you may have rrdcached setup incorrectly. In /usr/local/nagios/etc/pnp/process_perfdata.cfg you should have

Code: Select all

RRD_DAEMON_OPTS = unix:/var/rrdtool/rrdcached/rrdcached.sock
Also, can you post the result of the following without grepping for anything

Code: Select all

tail -n 40 /usr/local/nagios/var/perfdata.log
Former Nagios employee
Creator:
Human Design Website
Get Your Human Design Chart
zaji_nms
Posts: 616
Joined: Tue Oct 16, 2012 12:28 am

Re: gaps in all bandwidth graphs

Post by zaji_nms »

Hi Scott,
We do have the Line in /usr/local/nagios/etc/pnp/process_perfdata.cfg, the output on the log below. Only in Bandwith graph the output in/out is 0 and sometimes with Value.


2012-12-27 08:40:33 [29390] [1] Found Performance Data for nuz-3750-1 / 0505_nuz_3750_1_1_0_24_nuz_7200_1_0_1_FE_RJ45_XX_Bandwidth (in=0Mb/s;75;90 out=0Mb/s;75;90)
2012-12-27 08:40:33 [29390] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/nuz-3750-1/0505_nuz_3750_1_1_0_24_nuz_7200_1_0_1_FE_RJ45_XX_Bandwidth.rrd 1356586824:0:0
2012-12-27 08:40:33 [29390] [2] /usr/local/nagios/share/perfdata/nuz-3750-1/0505_nuz_3750_1_1_0_24_nuz_7200_1_0_1_FE_RJ45_XX_Bandwidth.rrd updated
2012-12-27 08:40:33 [29390] [1] Found Performance Data for hwl-3750-1 / 0606_hwl_3750_1_1_0_14_hwl_malc_1_1_1_1_0_FE_RJ45_XX_Bandwidth (in=0Mb/s;75;90 out=0Mb/s;75;90)
Zajil NMS
zaji_nms
Posts: 616
Joined: Tue Oct 16, 2012 12:28 am

Re: gaps in all bandwidth graphs

Post by zaji_nms »

tail -n 40 /usr/local/pnp4nagios/var/perfdata.log

2012-12-27 08:47:07 [13738] [2] Processing Line 65
2012-12-27 08:47:07 [13739] [2] No Perfdata. Skipping line 91
2012-12-27 08:47:07 [13739] [2] Processing Line 92
2012-12-27 08:47:07 [13738] [2] Datatype set to 'HOSTPERFDATA'
2012-12-27 08:47:07 [13738] [1] Found Performance Data for egy-7200-1 / _HOST_ (rta=95.759003ms;150.000000;200.000000;0.000000 pl=0%;20;50;0)
2012-12-27 08:47:07 [13739] [2] Datatype set to 'SERVICEPERFDATA'
2012-12-27 08:47:07 [13739] [2] No Perfdata. Skipping line 92
2012-12-27 08:47:07 [13739] [2] Processing Line 93
2012-12-27 08:47:07 [13739] [2] Datatype set to 'SERVICEPERFDATA'
2012-12-27 08:47:07 [13739] [2] No Perfdata. Skipping line 93
2012-12-27 08:47:07 [13738] [2] data2rrd called
2012-12-27 08:47:07 [13739] [1] 93 lines processed
2012-12-27 08:47:07 [13739] [1] /usr/local/nagios/var/spool/perfdata/service-perfdata.1356587222-PID-13739 deleted
2012-12-27 08:47:07 [13738] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/egy-7200-1/_HOST_.rrd 1356587220:95.759003:0
2012-12-27 08:47:07 [13738] [2] /usr/local/nagios/share/perfdata/egy-7200-1/_HOST_.rrd updated
2012-12-27 08:47:07 [13738] [2] Processing Line 66
2012-12-27 08:47:07 [13738] [2] Datatype set to 'HOSTPERFDATA'
2012-12-27 08:47:07 [13738] [1] Found Performance Data for bgw-7200-1 / _HOST_ (rta=103.476997ms;150.000000;200.000000;0.000000 pl=0%;20;50;0)
2012-12-27 08:47:07 [13738] [2] data2rrd called
2012-12-27 08:47:07 [13739] [2] data2rrd called
2012-12-27 08:47:07 [13738] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/bgw-7200-1/_HOST_.rrd 1356587220:103.476997:0
2012-12-27 08:47:07 [13739] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/.pnp-internal/runtime_runtime.rrd 1356587212:0.643421
2012-12-27 08:47:07 [13739] [2] /usr/local/nagios/share/perfdata/.pnp-internal/runtime_runtime.rrd updated
2012-12-27 08:47:07 [13738] [2] /usr/local/nagios/share/perfdata/bgw-7200-1/_HOST_.rrd updated
2012-12-27 08:47:07 [13739] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/.pnp-internal/runtime_rows.rrd 1356587212:510
2012-12-27 08:47:07 [13738] [1] 66 lines processed
2012-12-27 08:47:07 [13738] [1] /usr/local/nagios/var/spool/perfdata/host-perfdata.1356587222-PID-13738 deleted
2012-12-27 08:47:07 [13739] [2] /usr/local/nagios/share/perfdata/.pnp-internal/runtime_rows.rrd updated
2012-12-27 08:47:07 [13738] [1] PNP exiting (runtime 0.076308s) ...
2012-12-27 08:47:07 [13739] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/.pnp-internal/runtime_errors.rrd 1356587212:24
2012-12-27 08:47:07 [13739] [2] /usr/local/nagios/share/perfdata/.pnp-internal/runtime_errors.rrd updated
2012-12-27 08:47:07 [13739] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/.pnp-internal/runtime_invalid.rrd 1356587212:0
2012-12-27 08:47:07 [13739] [2] /usr/local/nagios/share/perfdata/.pnp-internal/runtime_invalid.rrd updated
2012-12-27 08:47:07 [13739] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/.pnp-internal/runtime_skipped.rrd 1356587212:53
2012-12-27 08:47:07 [13739] [2] /usr/local/nagios/share/perfdata/.pnp-internal/runtime_skipped.rrd updated
2012-12-27 08:47:07 [13739] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/.pnp-internal/runtime_update.rrd 1356587212:433
2012-12-27 08:47:07 [13739] [2] /usr/local/nagios/share/perfdata/.pnp-internal/runtime_update.rrd updated
2012-12-27 08:47:07 [13739] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/.pnp-internal/runtime_create.rrd 1356587212:0
2012-12-27 08:47:07 [13739] [2] /usr/local/nagios/share/perfdata/.pnp-internal/runtime_create.rrd updated
2012-12-27 08:47:07 [13739] [1] PNP exiting (runtime 0.074569s) ...
Zajil NMS
zaji_nms
Posts: 616
Joined: Tue Oct 16, 2012 12:28 am

Re: gaps in all bandwidth graphs

Post by zaji_nms »

Our NPCD.cfg and process_perfdata.cfg are being used from /usr/local/pnp4nagios/etc



2012-12-27 09:46:29 [20828] [2] RRDs::update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/skb-3750-3/0202_skb_3750_3_1_0_11_skb_malc_2_1_1_1_0_FE_RJ45_XX_Bandwidth.rrd 1356590781:0:0
2012-12-27 09:46:29 [20828] [0] RRDs::update /usr/local/nagios/share/perfdata/skb-3750-3/0202_skb_3750_3_1_0_11_skb_malc_2_1_1_1_0_FE_RJ45_XX_Bandwidth.rrd 1356590781:0:0
2012-12-27 09:46:29 [20828] [0] RRDs::update ERROR rrdcached: illegal attempt to update using time 1356590781 when last update time is 1356590781 (minimum one second step)
Zajil NMS
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises

Re: gaps in all bandwidth graphs

Post by scottwilkerson »

Did you install a different version of pnp4nagios than the one that came with Nagios XI? This could have very undesirable affe3cts that have not been tested by our team
Former Nagios employee
Creator:
Human Design Website
Get Your Human Design Chart
zaji_nms
Posts: 616
Joined: Tue Oct 16, 2012 12:28 am

Re: gaps in all bandwidth graphs

Post by zaji_nms »

yes we installed the new pnp4nagios 6.19
Zajil NMS
slansing
Posts: 7698
Joined: Mon Apr 23, 2012 4:28 pm
Location: Travelling through time and space...

Re: gaps in all bandwidth graphs

Post by slansing »

We just had another question about this yesterday:
Xi actually uses a modified version of both PNP 0.4/0.6. The NPCD daemon and perfdata processing script are almost up to date to the latest version, while the front-end installed with XI is still 0.4. We haven't currently documented or tested the upgrade to the latest version, so at the moment we don't support it.
There are a lot of cool features with the new version, and I am sure our dev's are looking into it.