The system hangs when click on Report

This support forum board is for support questions relating to Nagios XI, our flagship commercial network monitoring solution.
rragha2
Posts: 17
Joined: Mon Aug 03, 2020 4:57 am

The system hangs when click on Report

Post by rragha2 »

Hi

Our system include around 20K Bandwidth service.

When we clicked on "Report" > "Bandwidth Usage", the system ran for a while and hang.

Please help to fix it.

Thanks,
Austin
You do not have the required permissions to view the files attached to this post.
ssax
Dreams In Code
Posts: 7682
Joined: Wed Feb 11, 2015 12:54 pm

Re: The system hangs when click on Report

Post by ssax »

Please PM me a copy of your profile, you can download it from Admin > System Profile by clicking the Download Profile button.

Please attach your /etc/php.ini file as well.

Additionally, please send the output of these commands:
- NOTE: You may need to adjust the -h 127.0.0.1, the -uroot, and -pnagiosxi in the first command if your DB is offloaded to another server and/or you've changed the root mysql password

Code: Select all

echo "SELECT table_name AS 'Table', round(((data_length + index_length) / 1024 / 1024), 2) 'Size in MB' FROM information_schema.TABLES WHERE table_schema IN ('nagios', 'nagiosql', 'nagiosxi');" | mysql -h 127.0.0.1 -uroot -pnagiosxi --table
This next command may fail, that's okay, not all systems run postgresql, send the output anyways:

Code: Select all

echo "SELECT relname as Table, pg_size_pretty(pg_total_relation_size(relid)) As Size, pg_size_pretty(pg_total_relation_size(relid) - pg_relation_size(relid)) as ExternalSize FROM pg_catalog.pg_statio_user_tables ORDER BY pg_total_relation_size(relid) DESC;" | psql nagiosxi nagiosxi
rragha2
Posts: 17
Joined: Mon Aug 03, 2020 4:57 am

Re: The system hangs when click on Report

Post by rragha2 »

Please refer the requested info in PM.
ssax
Dreams In Code
Posts: 7682
Joined: Wed Feb 11, 2015 12:54 pm

Re: The system hangs when click on Report

Post by ssax »

Please edit your /usr/local/nagiosxi/html/config.inc.php and change this:

Code: Select all

$cfg['use_https'] = false;
To this:

Code: Select all

$cfg['use_https'] = true;
I'm also seeing this:

Code: Select all

[Wed Dec 23 17:27:33.540877 2020] [:error] [pid 20583] [client X.X.127.226:51779] PHP Fatal error:  Maximum execution time of 600 seconds exceeded in /usr/local/nagiosxi/html/includes/components/bandwidthreport/index.php on line 1288, referer: https://X.X.127.233/nagiosxi/reports/
Given the size of your system, edit your /etc/php.ini and change these:

Code: Select all

max_execution_time = 3600
max_input_vars=50000
Then restart apache:

Code: Select all

systemctl restart httpd
Test the bandwidth report after that.

You are also hitting the load_threshold on your performance data which will stop graphs from being generated, please follow this KB article to increase your load_threshold to 60.0:

https://support.nagios.com/kb/article.php?id=9

Additionally, please send me the output of these commands:

Code: Select all

cat /etc/cron.d/mrtg
ls -lh /usr/local/nagios/var
You should also setup a RAMDisk as well:

https://assets.nagios.com/downloads/nag ... giosXI.pdf
rragha2
Posts: 17
Joined: Mon Aug 03, 2020 4:57 am

Re: The system hangs when click on Report

Post by rragha2 »

The system is still down after we changed the parameter you suggested and utilized the RAM disk.

Please find the output of commands you requested in the attachment.
You do not have the required permissions to view the files attached to this post.
ssax
Dreams In Code
Posts: 7682
Joined: Wed Feb 11, 2015 12:54 pm

Re: The system hangs when click on Report

Post by ssax »

Please PM me a fresh copy of your profile, you can download it from Admin > System Profile by clicking the Download Profile button.

Please run these commands to fix an issue with your /usr/local/nagios/var/rw directory:

Code: Select all

chown -R nagios.nagcmd /usr/local/nagios/var/rw
chmod g+s /usr/local/nagios/var/rw
systemctl restart nagios
rragha2
Posts: 17
Joined: Mon Aug 03, 2020 4:57 am

Re: The system hangs when click on Report

Post by rragha2 »

Please refer to Profile file in the attachment.

Moderator's Note: The profile has been shared with the support team but has been removed from the public forum.
ssax
Dreams In Code
Posts: 7682
Joined: Wed Feb 11, 2015 12:54 pm

Re: The system hangs when click on Report

Post by ssax »

I'm not seeing anything stand out other than your system having roughly 50K checks and it's showing IO wait of 6.4% which usually means you have slow disks, overprovisioned storage, or a bottleneck between the VM host and the VM storage (if a VM). That means your XI system is waiting on storage 6+% of the time which will slow your system down dramatically. Considering the report you are using queries the filesystem logs to parse them that IO wait will have an impact on it.

Additionally, you still need to edit your /usr/local/nagiosxi/html/config.inc.php and change this:

Code: Select all

$cfg['use_https'] = false;
To this:

Code: Select all

$cfg['use_https'] = true;
Please create a ticket for this and include a link back to this forum thread so we can get a remote session setup:

https://support.nagios.com/tickets/

Thank you!
ssax
Dreams In Code
Posts: 7682
Joined: Wed Feb 11, 2015 12:54 pm

Re: The system hangs when click on Report

Post by ssax »

Locking thread, ticket received, we will continue support through the ticket.

Thank you!