Performance graphs - Disk Usage (only) showing "no data"

nitsch · Post by **nitsch** » Fri Aug 14, 2020 7:53 am

Hi!

Since a couple of weeks, Disk Usage graphs stopped working and show "no data" - other graphs (cpu, memory) are working.

I can see data until a specific date - but don't know of any changes that day.
Data is actually collected, as I can see the current values and can refresh them with an immediate check.

ncpa log shows:

Code: Select all

[08-14-2020 14:41:35] NPCD: ThreadCounter 0/5 File is 1575033208.perfdata.service-PID-1206
[08-14-2020 14:41:35] NPCD: File '1575033208.perfdata.service-PID-1206' is an already in process PNP file. Leaving it untouched.
[08-14-2020 14:41:35] NPCD: DEBUG: load 0.850000/30.000000
[08-14-2020 14:41:35] NPCD: ThreadCounter 0/5 File is 1575033220.perfdata.service-PID-1211
[08-14-2020 14:41:35] NPCD: File '1575033220.perfdata.service-PID-1211' is an already in process PNP file. Leaving it untouched.
[08-14-2020 14:41:35] NPCD: No more files to process... waiting for 15 seconds

perfdata.log shows:

Code: Select all

2019-11-29 19:07:50 [43798] [0] *** process_perfdata.pl terminated on signal ALRM
2019-11-29 19:07:50 [43797] [0] *** Timeout while processing Host: "xxx.yyy.zzz" Service: "_HOST_"
2019-11-29 19:07:50 [43797] [0] *** process_perfdata.pl terminated on signal ALRM
2020-04-01 01:32:19 [60971] [0] *** TIMEOUT: Timeout after 5 secs. ***
2020-04-01 01:32:20 [60971] [0] *** TIMEOUT: Deleting current file to avoid NPCD loops
2020-04-01 01:32:19 [60970] [0] *** TIMEOUT: Timeout after 5 secs. ***
2020-04-01 01:32:20 [60971] [0] *** TIMEOUT: Please check your npcd.cfg
2020-04-01 01:32:20 [60970] [0] *** TIMEOUT: Deleting current file to avoid NPCD loops
2020-04-01 01:32:20 [60971] [0] *** TIMEOUT: /usr/local/nagios/var/spool/perfdata//1585697528.perfdata.service-PID-60971 deleted
2020-04-01 01:32:20 [60970] [0] *** TIMEOUT: Please check your npcd.cfg

Because of the timeout I modified (increased) following values:

/usr/local/nagios/etc/pnp/process_perfdata.cfg
TIMEOUT to 40

/usr/local/nagios/etc/pnp/npcd.cfg
sleep_time to 15

Still no change.

Any ideas how to approach this problem?

Kind Regards!

Post by **tgriep** » Fri Aug 14, 2020 3:01 pm

Typically when this happens, the command was changed and that changed the performance data output to change and that stopped the graph.

If you go to the Service Details for that service and look at the graph and note the label names and the number of labels.
Then go to the Advanced TAB and look at the Performance Data: filed and if that do not match, that is why the graph stopped.

To fix it, delete the .rrd and .xml files for that service so it will be recreated.
To do that, go to this folder (replace hostname with the actual hostname)

Code: Select all

/usr/local/nagios/share/perfdata/hostname

Delete the .rrd and .xml file with the name of the service and that should allow them to be updated.
Wait for 15 to 30 minutes for them to update in the GUI and see if that allows the graphs to update.

nitsch · Post by **nitsch** » Mon Aug 17, 2020 7:04 am

Thanks for your reply!

Partial success - Checking the .rrd file of an affected host I saw, that the modified date was the date until the graph was working.

With

Code: Select all

find . -name "Drive*.rrd" -mtime +30

in perfdata, I found all affected hosts. After I deleted a rrd file of an exemplary host, graphs started populating again

- hosts that are not affected show Disk Usage in Gb
- previously affected hosts (.rrd removed now) are now showing Disk Usage graphs again but in B instead of Gb.

So I was looking for differences and found out, that affected hosts are configured using check_xi_service_wmiplus whereas non affected hosts are using nsclient... what could possibly have changed so wmi query stopped working and now shows values in B?

Kind Regards.

Post by **tgriep** » Mon Aug 17, 2020 9:35 am

Without seeing the graph labels and the current Performance Data output of the plugin, I could only guess why they stopped graphing.

It could be a permission issue with the WMI account was changed so now it cannot see all of the disks on the system which could affect the performance data output.

nitsch · Post by **nitsch** » Mon Aug 17, 2020 10:08 am

Not sure if you mean these with labels?

l1.JPG

Performance Data Shows:

Performance Data: 'E: Space'=302686502912B; 'E: Utilisation'=40.3%;95;97; 'E: Size'=751616126976B;

So if there is data, I guess the account is working - else I would not be able to retrieve any data?

Kind Regards!

nitsch · Post by **nitsch** » Tue Aug 18, 2020 4:03 am

Hi!

I tested a little and found out, that when I run the check_wmi_plus.pl plugin manually from console, it returns following values:

Code: Select all

 ./check_wmi_plus.pl -H xx.xx.xx.xx -u xyz -p zyx -m checkdrivesize -a 'E'

Code: Select all

OK - E: Total=699.997GB, Used=281.93GB (40.3%), Free=418.068GB (59.7%)     |'E: Space'=302719496192B; 'E: Utilisation'=40.3%; 'E: Size'=751616126976B

In "Status Information" in the GUI I do see the output in GB - only the Performance graphs shows the values in B instead of GB.

Is there a way to change this?

Kind Regards!

Post by **tgriep** » Tue Aug 18, 2020 9:41 am

The plugin does not have an option to change the Performance data output to any other format except Bytes.

Nagios Support Forum

Performance graphs - Disk Usage (only) showing "no data"

Performance graphs - Disk Usage (only) showing "no data"

Re: Performance graphs - Disk Usage (only) showing "no data"

Re: Performance graphs - Disk Usage (only) showing "no data"

Re: Performance graphs - Disk Usage (only) showing "no data"

Re: Performance graphs - Disk Usage (only) showing "no data"

Re: Performance graphs - Disk Usage (only) showing "no data"

Re: Performance graphs - Disk Usage (only) showing "no data"