I'm running into the same issue found in https://support.nagios.com/forum/viewto ... 70#p321644 (Nagios XI - Last Check Time Not Updating).
Is installing the version of NDO supplied in that topic the supported fix?
Thanks...John
Nagios XI WebUI Problems After Upgrade to 5.7.5
-
- Posts: 115
- Joined: Wed Mar 13, 2019 2:06 pm
-
- Posts: 903
- Joined: Tue Oct 27, 2020 1:35 pm
Re: Nagios XI WebUI Problems After Upgrade to 5.7.5
Hi John,
Could you please first try repairing your DB? .... and restart services?
Here's the repair DB instruction:
https://assets.nagios.com/downloads/nag ... tabase.pdf
Also, below are a few log locations that you could start looking:
Regards,
Vinh
Could you please first try repairing your DB? .... and restart services?
Here's the repair DB instruction:
https://assets.nagios.com/downloads/nag ... tabase.pdf
Also, below are a few log locations that you could start looking:
Code: Select all
/var/log/mariadb/mariadb.log
/usr/local/nagios/var/nagios.log
/usr/local/nagios/var
/usr/local/nagiosxi/tmp
/usr/local/nagiosxi/var
/var/log/httpd/error_log
Vinh
-
- Posts: 115
- Joined: Wed Mar 13, 2019 2:06 pm
Re: Nagios XI WebUI Problems After Upgrade to 5.7.5
Vinh,
Repairing the database, which I also had to do after the upgrade, did not resolve the problem. I check the various logs and did find the following, related to npcd, though I can't say if its related.
/usr/local/nagios/var/npcd.log
[01-08-2021 14:32:26] NPCD: WARN: MAX load reached: load 14.650000/10.000000 at i=0
[01-08-2021 14:32:41] NPCD: WARN: MAX load reached: load 19.950000/10.000000 at i=1
[01-08-2021 14:32:56] NPCD: WARN: MAX load reached: load 18.150000/10.000000 at i=1
[01-08-2021 14:33:11] NPCD: WARN: MAX load reached: load 15.440000/10.000000 at i=1
[01-08-2021 14:33:26] NPCD: WARN: MAX load reached: load 12.670000/10.000000 at i=1
[01-08-2021 14:33:41] NPCD: WARN: MAX load reached: load 10.700000/10.000000 at i=1
[01-08-2021 14:33:56] NPCD: WARN: MAX load reached: load 14.320000/10.000000 at i=1
[01-08-2021 14:34:11] NPCD: WARN: MAX load reached: load 16.280000/10.000000 at i=1
[01-08-2021 14:34:26] NPCD: WARN: MAX load reached: load 19.750000/10.000000 at i=1
[01-08-2021 14:34:41] NPCD: WARN: MAX load reached: load 17.120000/10.000000 at i=1
[01-08-2021 14:34:56] NPCD: WARN: MAX load reached: load 14.190000/10.000000 at i=1
[01-08-2021 14:35:11] NPCD: WARN: MAX load reached: load 12.730000/10.000000 at i=1
[01-08-2021 14:35:26] NPCD: WARN: MAX load reached: load 10.350000/10.000000 at i=1
/usr/local/nagios/var/perfdata.log
2021-01-08 14:36:05 [88596] [0] *** TIMEOUT: Timeout after 5 secs. ***
2021-01-08 14:36:05 [88596] [0] *** TIMEOUT: Deleting current file to avoid NPCD loops
2021-01-08 14:36:05 [88596] [0] *** TIMEOUT: Please check your npcd.cfg
2021-01-08 14:36:05 [88596] [0] *** TIMEOUT: /usr/local/nagios/var/spool/perfdata//1610134463.perfdata.service-PID-88596 deleted
2021-01-08 14:36:05 [88596] [0] *** Timeout while processing Host: "hostname" Service: "prod__core__disk___var__used_95_98"
2021-01-08 14:36:05 [88596] [0] *** process_perfdata.pl terminated on signal ALRM
Repairing the database, which I also had to do after the upgrade, did not resolve the problem. I check the various logs and did find the following, related to npcd, though I can't say if its related.
/usr/local/nagios/var/npcd.log
[01-08-2021 14:32:26] NPCD: WARN: MAX load reached: load 14.650000/10.000000 at i=0
[01-08-2021 14:32:41] NPCD: WARN: MAX load reached: load 19.950000/10.000000 at i=1
[01-08-2021 14:32:56] NPCD: WARN: MAX load reached: load 18.150000/10.000000 at i=1
[01-08-2021 14:33:11] NPCD: WARN: MAX load reached: load 15.440000/10.000000 at i=1
[01-08-2021 14:33:26] NPCD: WARN: MAX load reached: load 12.670000/10.000000 at i=1
[01-08-2021 14:33:41] NPCD: WARN: MAX load reached: load 10.700000/10.000000 at i=1
[01-08-2021 14:33:56] NPCD: WARN: MAX load reached: load 14.320000/10.000000 at i=1
[01-08-2021 14:34:11] NPCD: WARN: MAX load reached: load 16.280000/10.000000 at i=1
[01-08-2021 14:34:26] NPCD: WARN: MAX load reached: load 19.750000/10.000000 at i=1
[01-08-2021 14:34:41] NPCD: WARN: MAX load reached: load 17.120000/10.000000 at i=1
[01-08-2021 14:34:56] NPCD: WARN: MAX load reached: load 14.190000/10.000000 at i=1
[01-08-2021 14:35:11] NPCD: WARN: MAX load reached: load 12.730000/10.000000 at i=1
[01-08-2021 14:35:26] NPCD: WARN: MAX load reached: load 10.350000/10.000000 at i=1
/usr/local/nagios/var/perfdata.log
2021-01-08 14:36:05 [88596] [0] *** TIMEOUT: Timeout after 5 secs. ***
2021-01-08 14:36:05 [88596] [0] *** TIMEOUT: Deleting current file to avoid NPCD loops
2021-01-08 14:36:05 [88596] [0] *** TIMEOUT: Please check your npcd.cfg
2021-01-08 14:36:05 [88596] [0] *** TIMEOUT: /usr/local/nagios/var/spool/perfdata//1610134463.perfdata.service-PID-88596 deleted
2021-01-08 14:36:05 [88596] [0] *** Timeout while processing Host: "hostname" Service: "prod__core__disk___var__used_95_98"
2021-01-08 14:36:05 [88596] [0] *** process_perfdata.pl terminated on signal ALRM
-
- Posts: 903
- Joined: Tue Oct 27, 2020 1:35 pm
Re: Nagios XI WebUI Problems After Upgrade to 5.7.5
Hi John,
Looks like your systems load it high, it will stop processing performance graphs which would add to the load.
The setting of 10 is if the average load of the system is over 10, then it will stop processing the graph data.
To find out the processes that are generating the most load, run the following as root on the Nagios server.
It will show the top 20 processes.
Regards,
Vinh
Looks like your systems load it high, it will stop processing performance graphs which would add to the load.
The setting of 10 is if the average load of the system is over 10, then it will stop processing the graph data.
To find out the processes that are generating the most load, run the following as root on the Nagios server.
It will show the top 20 processes.
Code: Select all
top -b -n1 |head -n 27
Vinh
-
- Posts: 115
- Joined: Wed Mar 13, 2019 2:06 pm
Re: Nagios XI WebUI Problems After Upgrade to 5.7.5
Attached is the current load for localhost over the past 7 days. The spike coincides with the upgrade.
You do not have the required permissions to view the files attached to this post.
-
- Posts: 115
- Joined: Wed Mar 13, 2019 2:06 pm
Re: Nagios XI WebUI Problems After Upgrade to 5.7.5
Is it possible to determine if I am having the same NDO issue as was reported in the other post? This delay is going to cause issues with our Nagios users who are looking to make configuration changes. For example, disabling alerts for a service check is not reflected in the Nagios XI Web UI for some time, however it does show up in the Nagios Core WebUI immediately.
-
- Posts: 903
- Joined: Tue Oct 27, 2020 1:35 pm
Re: Nagios XI WebUI Problems After Upgrade to 5.7.5
HI John,
I checked with one of my teammate and was told that the version NDO3 came with XI 5.7.5 does have the bug that effect the statuses from updating in a timely manner.
So update is needed or wait for Nagios XI 5.8 (to be released very soon).
Attached is the latest "ndo-master.zip" file
Copy the ndo-master.zip file to the XI server and run the following to compile, install it and to restart nagios.
Restart nagios to load the new broker
Regards,
Vinh
I checked with one of my teammate and was told that the version NDO3 came with XI 5.7.5 does have the bug that effect the statuses from updating in a timely manner.
So update is needed or wait for Nagios XI 5.8 (to be released very soon).
Attached is the latest "ndo-master.zip" file
Copy the ndo-master.zip file to the XI server and run the following to compile, install it and to restart nagios.
Code: Select all
unzip ndo-master.zip
cd ndo-master
./configure
make all
make install
Code: Select all
service nagios restart
Vinh
You do not have the required permissions to view the files attached to this post.
-
- Posts: 1
- Joined: Mon Jan 11, 2021 11:43 am
Re: Nagios XI WebUI Problems After Upgrade to 5.7.5
This solved a similar issue for me. I had been troubleshooting an issue brought on by an upgrade from Debian 9 to Debian 10. It appeared the ndo module relied on a mariadb shared library that wasn't distributed with Deb10. I'd tried install ndoutils from source as per https://support.nagios.com/kb/article/n ... tml#Debian, and that got the nagios service to start, but none of the services were updating on the dashboard (though the history graphs showed new data). Installing from that zip fixed it. Thanks!
-
- Posts: 115
- Joined: Wed Mar 13, 2019 2:06 pm
Re: Nagios XI WebUI Problems After Upgrade to 5.7.5
I applied the fix and ran some checks and it looks like this resolved most, but not all issues. New hosts still show up with the last check of 1970-01-01. There are also no additional services until the host checks in. I will note that this is now working faster than previously, see the screenshot:
So were better then we were before installing the fix, but were not where we should be. Is there anything else we can look at or will we need to wait until 5.8?
Thanks
I also added a service check and found similar results The new check does not show up in the XI Web UI for 4 minutes. If you check the Core Web UI, then new check is listed.So were better then we were before installing the fix, but were not where we should be. Is there anything else we can look at or will we need to wait until 5.8?
Thanks
You do not have the required permissions to view the files attached to this post.
-
- Posts: 903
- Joined: Tue Oct 27, 2020 1:35 pm
Re: Nagios XI WebUI Problems After Upgrade to 5.7.5
Hi John,
Could you please upload the "nagios.log" and the "nagios.cfg" so I can take a look?
Regards,
Vinh
Could you please upload the "nagios.log" and the "nagios.cfg" so I can take a look?
Code: Select all
/usr/local/nagios/var/nagios.log
/usr/local/nagios/etc/nagios.cfg
Vinh