Some Performance graphs not graphing

hbouma · Post by **hbouma** » Thu Nov 04, 2021 7:53 am

We recently updated our Memory and Swap monitoring to use a percentage instead of a hard limit. Now, the memory graphs and swap graphs are showing blank. The same is happening with our newly created Page File checks.

Using RHEL 7 VMs for Nagios XI 5.8.6.

Memory check:
check_xi_ncpa!-t 'TOKEN' -P 5693 -M memory/virtual/percent -w 80 -c 90

Page File:
check_xi_ncpa!-t 'TOKEN' -P 5693 -M 'windowscounters//Paging File(*)/% Usage' -w '80' -c '90'

Swap check:
check_xi_ncpa!-t 'TOKEN' -P 5693 -M memory/swap/percent -w 80 -c 90

All other checks are graphing properly.

Post by **pbroste** » Fri Nov 05, 2021 9:09 am

Hello @hbouma

Thanks for reaching out and want to get the updated System Profile so we can check on things to see what is going on.

To send us your system profile.

Login to the Nagios XI GUI using a web browser.
Click the "Admin" > "System Profile" Menu
Click the "Download Profile" button
Save the profile.zip file and send via Private Message

Thanks,
Perry

hbouma · Post by **hbouma** » Fri Nov 05, 2021 9:14 am

Info sent via PM.

Post by **pbroste** » Fri Nov 05, 2021 4:30 pm

Hello @hbouma

Let's also verify that performance data is showing up on the checks by heading over to the Core web console.

Code: Select all

https://yourhostaddresshere/nagios/

Example:

Thanks,
Perry

Post by **pbroste** » Fri Nov 05, 2021 4:42 pm

Hello @hbouma

Or from the XI web console in advanced:

Thanks,
Perry

hbouma · Post by **hbouma** » Fri Nov 05, 2021 8:09 pm

Nagios core shows performance data. Nagios XI shows performance data. However, the Performance graph is showing no data to display.

2021-11-05 21_08_20-Window.png

Post by **pbroste** » Mon Nov 08, 2021 2:21 pm

Hello @hbouma

Thanks for following up, is this issue related to the environment on support thread 'Nagios ramdisk full and no performance graphs? If so could be related issues.

From the screenshot, we can see that the service check is providing graph data and that the data is sent over to the Performance Data process engine.

Please let us know how things look on the Performance Data process end of things.

Thanks,
Perry

hbouma · Post by **hbouma** » Mon Nov 08, 2021 2:30 pm

This is a different environment. The RAMDISK is pretty empty and processing lots of checks in this environment. I do see the host-perfdata and service-perfdata changing values, but they always shrink again once the cron job is run to process the perfdata.

As I work through this link https://support.nagios.com/kb/article.php?id=9, I see no spooled files waiting to be processed.

Perdata log doesn't show any issues. For instance, I show this line for a server that has no performance data for the Memory Usage check.

2021-11-08 14:15:38 [4882] [1] Found Performance Data for SERVERNAME/ Memory_Usage ('percent'=65.50%;80;90;)
2021-11-08 14:15:38 [4879] [1] rrdtool update returns 0

NPCD is running

The Nagios account is not locked and is set to never expire.

Post by **pbroste** » Tue Nov 09, 2021 10:55 am

We want to find out why we are not seeing spooled by increasing the logging verbose.

Before doing that, let's have you go to the web console with Development Tools > Network Tab open, and bing up a performance graph that is not showing up and reload the page and watch for any errors:

*Also the option, to tail -F the Apache logs (tail -F /var/log/httpd/*)

Code: Select all

 /usr/local/nagios/etc/pnp/process_perfdata.cfg

Change:
LOG_LEVEL = 0
To:
LOG_LEVEL = 2

The (ps -aux | grep -Ei 'process_perfdata.pl') script should now log all errors:

Code: Select all

tail -f /usr/local/nagios/var/perfdata.log

If the logging is not providing additional info, let's go ahead and increase the logging on NPCD and watch that:

Code: Select all

tail -f /usr/local/nagios/var/npcd.log

Would you please provide all that you see helpful?

Thanks,
Perry

hbouma · Post by **hbouma** » Wed Nov 10, 2021 9:01 am

No errors when loading the page. Everything comes back with a 200 response.

Ok, I had previously been looking at /usr/local/nagiosxi/var/perfdataproc.log when I saw the 0 files processed.

Here is what I see in /usr/local/nagios/var/perfdata.log

FYI, despite the fact that it shows processing the data, I have no data in the performance graph in Nagios XI

Code: Select all

2021-11-10 08:50:58 [11484] [1] Found Performance Data for SERVER/ Memory_Usage ('percent'=70.70%;80;90;)
2021-11-10 08:50:58 [11487] [3]   -- uom -> ms
2021-11-10 08:50:58 [11487] [3]   -- value -> 0.117
2021-11-10 08:50:58 [11484] [3] DEBUG: Normal perfdata
2021-11-10 08:50:58 [11487] [3]   -- warning -> 3000.000
2021-11-10 08:50:58 [11487] [3] DEBUG: SINGLE Storage Type
2021-11-10 08:50:58 [11484] [3] DEBUG: UOM adjust = %%
2021-11-10 08:50:58 [11484] [3] DEBUG: RAW Command -> check_xi_ncpa!-t 'TOKEN' -P 5693 -M memory/virtual/percent -w 80 -c 90!!!!!!!
2021-11-10 08:50:58 [11487] [3]  -- Job 1
2021-11-10 08:50:58 [11484] [2] No Custom Template found for check_xi_ncpa (/usr/local/nagios/etc/pnp/check_commands/check_xi_ncpa.cfg)
2021-11-10 08:50:58 [11487] [3]   -- auth_hostname -> SERVER
2021-11-10 08:50:58 [11484] [3] RRD Datatype is GAUGE
2021-11-10 08:50:58 [11487] [3]   -- auth_servicedesc -> Host Perfdata
2021-11-10 08:50:58 [11484] [2] Template is check_xi_ncpa.php
2021-11-10 08:50:58 [11487] [3]   -- critical -> 100
2021-11-10 08:50:58 [11487] [3]   -- disp_hostname -> SERVER
2021-11-10 08:50:58 [11487] [3]   -- disp_servicedesc -> Host Perfdata
2021-11-10 08:50:58 [11484] [2] data2rrd called
2021-11-10 08:50:58 [11487] [3]   -- dstype -> GAUGE
2021-11-10 08:50:58 [11487] [3]   -- hostname -> SERVER
2021-11-10 08:50:58 [11484] [3] DEBUG: XML File is 618 seconds old. UPDATE!
2021-11-10 08:50:58 [11487] [3]   -- label -> pl
2021-11-10 08:50:58 [11487] [3]   -- max -> 100
2021-11-10 08:50:58 [11487] [3]   -- min -> 0
2021-11-10 08:50:58 [11484] [3]  -- Job 0
2021-11-10 08:50:58 [11487] [3]   -- multi -> 0
2021-11-10 08:50:58 [11484] [3]   -- auth_hostname -> SERVER
2021-11-10 08:50:58 [11487] [3]   -- name -> pl
2021-11-10 08:50:58 [11484] [3]   -- auth_servicedesc -> Memory Usage
2021-11-10 08:50:58 [11487] [3]   -- rrd_heartbeat -> 8460
2021-11-10 08:50:58 [11484] [3]   -- critical -> 90
2021-11-10 08:50:58 [11487] [3]   -- rrd_max -> U
2021-11-10 08:50:58 [11484] [3]   -- disp_hostname -> SERVER
2021-11-10 08:50:58 [11487] [3]   -- rrd_min -> U
2021-11-10 08:50:58 [11484] [3]   -- disp_servicedesc -> Memory Usage
2021-11-10 08:50:58 [11487] [3]   -- rrd_storage_type -> SINGLE
2021-11-10 08:50:58 [11484] [3]   -- dstype -> GAUGE
2021-11-10 08:50:58 [11487] [3]   -- servicedesc -> _HOST_
2021-11-10 08:50:58 [11485] [1] rrdtool update returns 0
2021-11-10 08:50:58 [11484] [3]   -- hostname -> SERVER
2021-11-10 08:50:58 [11487] [3]   -- template -> check_xi_host_ping
2021-11-10 08:50:58 [11484] [3]   -- label -> percent
2021-11-10 08:50:58 [11487] [3]   -- uom -> %%
2021-11-10 08:50:58 [11484] [3]   -- multi -> 0
2021-11-10 08:50:58 [11487] [3]   -- value -> 0
2021-11-10 08:50:58 [11484] [3]   -- name -> percent
2021-11-10 08:50:58 [11487] [3]   -- warning -> 80
2021-11-10 08:50:58 [11484] [3]   -- rrd_heartbeat -> 8460
2021-11-10 08:50:58 [11487] [3] DEBUG: SINGLE Storage Type
2021-11-10 08:50:58 [11484] [3]   -- rrd_max -> U
2021-11-10 08:50:58 [11484] [3]   -- rrd_min -> U
2021-11-10 08:50:58 [11484] [3]   -- rrd_storage_type -> SINGLE
2021-11-10 08:50:58 [11487] [3]  -- Job 2
2021-11-10 08:50:58 [11484] [3]   -- servicedesc -> Memory_Usage
2021-11-10 08:50:58 [11484] [3]   -- template -> check_xi_ncpa
2021-11-10 08:50:58 [11487] [3]   -- auth_hostname -> SERVER
2021-11-10 08:50:58 [11485] [2] Processing Line 19
2021-11-10 08:50:58 [11484] [3]   -- uom -> %%
2021-11-10 08:50:58 [11487] [3]   -- auth_servicedesc -> Host Perfdata
2021-11-10 08:50:58 [11484] [3]   -- value -> 70.70
2021-11-10 08:50:58 [11487] [3]   -- disp_hostname -> SERVER
2021-11-10 08:50:58 [11484] [3]   -- warning -> 80
2021-11-10 08:50:58 [11487] [3]   -- disp_servicedesc -> Host Perfdata
2021-11-10 08:50:58 [11484] [3] DEBUG: SINGLE Storage Type
2021-11-10 08:50:58 [11487] [3]   -- dstype -> GAUGE
2021-11-10 08:50:58 [11485] [2] Datatype set to 'HOSTPERFDATA'
2021-11-10 08:50:58 [11487] [3]   -- hostname -> SERVER
2021-11-10 08:50:58 [11487] [3]   -- label -> rtmax
.........
2021-11-10 08:53:04 [18617] [3] DEBUG: SINGLE Storage Type
2021-11-10 08:53:04 [18617] [3] DEBUG: TPL-> check_xi_host_ping
2021-11-10 08:53:04 [18617] [3] DEBUG: CRE-> DS:1:GAUGE:8460:U:U DS:2:GAUGE:8460:U:U DS:3:GAUGE:8460:U:U DS:4:GAUGE:8460:U:U
2021-11-10 08:53:04 [18617] [3] DEBUG: UPD-> :0.646:0:0.722:0.577
2021-11-10 08:53:04 [18617] [2] RRDs Perl Modules are not installed. Falling back to rrdtool system call.
2021-11-10 08:53:04 [18617] [2] /bin/rrdtool update --daemon=unix:/var/rrdtool/rrdcached/rrdcached.sock /usr/local/nagios/share/perfdata/SERVER/_HOST_.rrd 1636552311:0.646:0:0.722:0.577
2021-11-10 08:53:04 [18612] [2] Processing Line 159

I see nothing odd in the ncpd logs. I will send you both logs via PM to double check.

Nagios Support Forum

Some Performance graphs not graphing

Some Performance graphs not graphing

Re: Some Performance graphs not graphing

Re: Some Performance graphs not graphing

Re: Some Performance graphs not graphing

Re: Some Performance graphs not graphing

Re: Some Performance graphs not graphing

Re: Some Performance graphs not graphing

Re: Some Performance graphs not graphing

Re: Some Performance graphs not graphing

Re: Some Performance graphs not graphing