low perfomance of nagiosxi

andaks · Post by **andaks** » Wed May 02, 2012 12:31 am

Hello everybody:)
Guys, could you help me with nagiosxi perfomance optimization?
I have read several documents about nagiosxi optimization but I need detailed information.
Maybe some advices about apache-server optimization, about database opt, and of course nagios opt.

scottwilkerson · Post by **scottwilkerson** » Wed May 02, 2012 10:00 am

This picture isn't particularly useful in diagnosing the problem as it doesn't show what is using all the CPU...

One of our developer did an excellent writeup a couple months ago regarding performance tuning that have some additional items you may want to look into to reduce load
http://labs.nagios.com/2012/01/30/nagio ... g-disk-io/

andaks · Post by **andaks** » Thu May 03, 2012 11:47 pm

oops...
Have some problems...
Try to optimize http://assets.nagios.com/downloads/nagi ... ios_XI.pdf
And now have no graphs. They stopped draw when i started installation of the latest rrdtool version from sources.
In the article I noticed the line where we should delete outdate rrdtool-perl. When I did it also have deleted dependence nagiosxideps.
After that I have no graphs. Althoug I was able to get rrd.journal file
Could you point me the right direction please.

andaks · Post by **andaks** » Fri May 04, 2012 12:47 am

rrdtool-perl...
Does it mean that I need a new version of it?
It was 1.38. But now I have rrdtool 1.47 from sources.

andaks · Post by **andaks** » Fri May 04, 2012 2:14 am

another question.
graphs appeared successfully from time to time. Everything can be fine within an hour, or may go wrong. In the second case graphs can not be updated some time and after that appear new created rrd.journal file. There are two files at this moment. Also rrd Displays graphics with a delay of two-three hours (in case when graphs are ok). I guess there is a problem with flushing data from the rrd.journal. Because when I do restart the service rrdcached, file rrd.journal become empty, without any data. How to fix this problem?
Thank you in advance guys. Will be waiting for feedback.

scottwilkerson · Post by **scottwilkerson** » Fri May 04, 2012 8:45 am

My guess this is caused by the load threshold in /usr/local/nagios/etc/pnp/npcd.cfg

With multi-CPU server we can increase this a lot
Edit /usr/local/nagios/etc/pnp/npcd.cfg and change

Code: Select all

load_threshold = 10.0

to

Code: Select all

load_threshold = 40.0

Also while in there, to decrease load you should make sure

Code: Select all

log_level = 0

mguthrie · Post by **mguthrie** » Fri May 04, 2012 9:11 am

Can you post your /etc/sysconfig/rrdcached config?

Also, what is the size of your environment. How many hosts+services are you monitoring and how often do you have the checks running?

andaks · Post by **andaks** » Sun May 06, 2012 10:14 pm

Hey guys! You are the best!!!
I have no problem with time now

Of course I almost always have threshold over 10, because of it I had such prroblem with graphs. Now its ok

But, my system is still overloaded.

rrdcached config:

Code: Select all

# Settings for rrdcached
OPTIONS="-l unix:/var/rrdtool/rrdcached/rrdcached.sock -F -s nagios -m 0660 -w 900 -z 90 -j /tmp/ -b /var/rrdtool/rrdcached -P FLUSH,PENDING"
RRDC_USER=nagios

There are 123 hosts, 1098 services. 4 CPU 4 Gb of RAM. Checking starts every 5 or 3 minutes. Mainly 5 minutes.

mguthrie · Post by **mguthrie** » Mon May 07, 2012 11:04 am

That CPU load seems awfully high for that kind of check load, unless it all happens to be checks against VMware. Are the performance graphs updating more consistently now?

Make sure you don't have corruption in your database, that'll eat CPU in a major way:
http://assets.nagios.com/downloads/nagi ... tabase.pdf

Also run:

Code: Select all

psql nagiosxi nagiosxi
vacuum;
vacuum analyze;
vacuum full;
\q

If your performance data processing gets behind, it can definitely create a snowball for your CPU usage. What kind of average CPU load are you running now the the graphs are updating more consistently?

I would take a look at this doc as well if you haven't already:
http://assets.nagios.com/downloads/nagi ... rmance.pdf

andaks · Post by **andaks** » Tue May 08, 2012 12:10 am

Yes, graphics are update every 15 minutes now

Already repaired mysql database nagios. But it seems that just indexes were fixed. Nothing more.
Run the following:

Code: Select all

#> psql nagiosxi nagiosxi
	nagiosxi=> vacuum;
	WARNING:  skipping "pg_database" --- only superuser can vacuum it
	WARNING:  skipping "pg_authid" --- only superuser can vacuum it
	WARNING:  skipping "pg_tablespace" --- only superuser can vacuum it
	WARNING:  skipping "pg_pltemplate" --- only superuser can vacuum it
	WARNING:  skipping "pg_shdepend" --- only superuser can vacuum it
	WARNING:  skipping "pg_shdescription" --- only superuser can vacuum it
	WARNING:  skipping "pg_auth_members" --- only superuser can vacuum it
	VACUUM

Now I have reduced load on my CPU but not enough:

Nagios Support Forum

low perfomance of nagiosxi

low perfomance of nagiosxi

Re: low perfomance of nagiosxi

Re: low perfomance of nagiosxi

Re: low perfomance of nagiosxi

Re: low perfomance of nagiosxi

Re: low perfomance of nagiosxi

Re: low perfomance of nagiosxi

Re: low perfomance of nagiosxi

Re: low perfomance of nagiosxi

Re: low perfomance of nagiosxi