Nagios xi performance

This support forum board is for support questions relating to Nagios xi, our flagship commercial network monitoring solution.
mguthrie
Posts: 4380
Joined: Mon Jun 14, 2010 10:21 am

Re: Nagios xi performance

Post by mguthrie »

Just to verify, do the slave machines have the following plugin?

/usr/local/nagios/libexec/check_wmi_plus.pl

If so, what are the permissions on it?
paul.jobb
Posts: 167
Joined: Tue Aug 02, 2011 4:37 pm

Re: Nagios xi performance

Post by paul.jobb »

they do, I did test running the check_wmi_plus script from the command line of the slave machine and it did work. I am also getting failures on my ping tests

[Wed Feb 1 14:20:43.203 2012] Service handler received service check [26] at 1328131243.
[Wed Feb 1 14:20:43.203 2012] Allocating node request.
[Wed Feb 1 14:20:43.203 2012] dnxGetNodeRequest: Unable to fulfill node request: Resource was not found.
[Wed Feb 1 14:20:43.203 2012] Post failed: Resource was not found. Service check [26] will execute locally: /usr/local/nagios/libexec/check_icmp -H 999.999.81.35 -w 3000.0,80% -c 5000.0,100% -p 5.


The slave machines are the same xi vm appliances that I downloaded and am using for the dnx master (2011R1.9)

I seem to recall when I installed the DNX server that it prompted for a password for the 'nagios' account on the slaves, that script indicated the password by default was 'welcome'. I couldn't find the default pw in the documenation for those machines so I did reset them to use welcome.
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises

Re: Nagios xi performance

Post by scottwilkerson »

paul.jobb wrote:they do, I did test running the check_wmi_plus script from the command line of the slave machine and it did work. I am also getting failures on my ping tests
It still could be a permissions issue.

On the slave machine can you run

Code: Select all

ls -l /usr/local/nagios/libexec
Former Nagios employee
Creator:
Human Design Website
Get Your Human Design Chart
paul.jobb
Posts: 167
Joined: Tue Aug 02, 2011 4:37 pm

Re: Nagios xi performance

Post by paul.jobb »

Code: Select all

[root@vnl62 ~]# ls -l /usr/local/nagios/libexec
total 4512
-rwxr-xr-x. 1 root   root    65068 Aug 29 07:28 check_apt
-rwxr-xr-x. 1 root   root     6897 Aug 29 07:30 check_asterisk.pl
-rwxr-xr-x  1 nagios users    4173 Oct 31 13:58 check_bl
-rwxr-xr-x  1 nagios users    2289 Aug 29 08:55 check_bpi.php
-rwxr-xr-x. 1 root   root     2274 Aug 29 07:28 check_breeze
lrwxrwxrwx. 1 root   root        9 Aug 29 07:28 check_clamd -> check_tcp
-rwxr-xr-x. 1 root   root    40575 Aug 29 07:28 check_cluster
-r-sr-xr-x. 1 root   root    73301 Aug 29 07:28 check_dhcp
-rwxr-xr-x. 1 root   root    71777 Aug 29 07:28 check_dig
-rwxr-xr-x. 1 root   root   101991 Aug 29 07:28 check_disk
-rwxr-xr-x. 1 root   root     8163 Aug 29 07:28 check_disk_smb
-rwxr-xr-x. 1 root   root    79570 Aug 29 07:28 check_dns
-rwxr-xr-x. 1 root   root    36412 Aug 29 07:28 check_dummy
-rwxr-xr-x  1 nagios users    5625 Aug 29 08:59 check_em01.pl
-rwxr-xr-x  1 nagios users   38345 Aug 29 08:57 check_email_delivery
-rwxr-xr-x  1 nagios users   20511 Aug 29 08:57 check_email_delivery_epn
-rwxr-xr-x. 1 root   root    20039 Aug 29 07:30 check_email_loop.pl
-rwxr-xr-x. 1 root   root     3143 Aug 29 07:28 check_file_age
-rwxr-xr-x. 1 root   root     6395 Aug 29 07:28 check_flexlm
-rwxr-xr-x. 1 root   root    74960 Aug 29 07:28 check_fping
lrwxrwxrwx. 1 root   root        9 Aug 29 07:28 check_ftp -> check_tcp
-rwxr-xr-x  1 nagios users    3437 Aug 29 09:00 check_ftp_fully
-rwxr-xr-x. 1 root   root    73830 Aug 29 07:28 check_hpjd
-rwxr-xr-x. 1 root   root   171978 Aug 29 07:28 check_http
-r-sr-xr-x. 1 root   root    80061 Aug 29 07:28 check_icmp
-rwxr-xr-x. 1 root   root    47064 Aug 29 07:28 check_ide_smart
-rwxr-xr-x. 1 root   root    15310 Aug 29 07:28 check_ifoperstatus
-rwxr-xr-x. 1 root   root    12853 Aug 29 07:28 check_ifstatus
lrwxrwxrwx. 1 root   root        9 Aug 29 07:28 check_imap -> check_tcp
-rwxr-xr-x  1 nagios users   35413 Aug 29 08:57 check_imap_receive
-rwxr-xr-x  1 nagios users   15576 Aug 29 08:57 check_imap_receive_epn
-rwxr-xr-x. 1 root   root     7429 Aug 29 07:28 check_ircd
lrwxrwxrwx. 1 root   root        9 Aug 29 07:28 check_jabber -> check_tcp
-rwxr-xr-x. 1 root   root    59134 Aug 29 07:28 check_ldap
lrwxrwxrwx. 1 root   root       10 Aug 29 07:28 check_ldaps -> check_ldap
-rwxr-xr-x. 1 root   root    59194 Aug 29 07:28 check_load
-rwxr-xr-x. 1 root   root     6062 Aug 29 07:28 check_log
-rwxr-xr-x. 1 root   root    20367 Aug 29 07:28 check_mailq
-rwxr-xr-x. 1 root   root    47300 Aug 29 07:28 check_mrtg
-rwxr-xr-x. 1 root   root    46703 Aug 29 07:28 check_mrtgtraf
-rwxr-xr-x. 1 root   root    11427 Aug 29 07:30 check_mssql
-rwxr-xr-x  1 nagios users   11625 Dec 19 09:07 check_mssql_database.py
-rwxr-xr-x  1 nagios users   17550 Dec 19 09:07 check_mssql_server.py
-rwxr-xr-x. 1 root   root    78008 Aug 29 07:28 check_mysql
-rwxr-xr-x. 1 root   root    98711 Aug 29 07:30 check_mysql_health
-rwxr-xr-x. 1 root   root    71648 Aug 29 07:28 check_mysql_query
-rwxr-xr-x. 1 root   root    59417 Aug 29 07:28 check_nagios
-rwxr-xr-x  1 nagios users    6364 Aug 29 09:07 check_nagios_performance.php
-rwxr-xr-x  1 nagios users   17209 Dec 19 09:07 check_nagiosxiserver.php
lrwxrwxrwx. 1 root   root        9 Aug 29 07:28 check_nntp -> check_tcp
lrwxrwxrwx. 1 root   root        9 Aug 29 07:28 check_nntps -> check_tcp
-rwxrwxr-x. 1 nagios nagios  69216 Aug 29 07:30 check_nrpe
-rwxr-xr-x. 1 root   root    74851 Aug 29 07:28 check_nt
-rwxr-xr-x. 1 root   root    76550 Aug 29 07:28 check_ntp
-rwxr-xr-x. 1 root   root    68987 Aug 29 07:28 check_ntp_peer
-rwxr-xr-x. 1 root   root    66180 Aug 29 07:28 check_ntp_time
-rwxr-xr-x. 1 root   root   102418 Aug 29 07:28 check_nwstat
-rwxr-xr-x. 1 root   root     8366 Aug 29 07:28 check_oracle
-rwxr-xr-x. 1 root   root    60153 Aug 29 07:28 check_overcr
-rwxr-xr-x. 1 root   root    55894 Aug 29 07:28 check_pgsql
-rwxr-xr-x. 1 root   root    80896 Aug 29 07:28 check_ping
-rwxr-xr-x  1 nagios nagios   6183 Dec 19 08:48 check_pnp_rrds.pl
lrwxrwxrwx. 1 root   root        9 Aug 29 07:28 check_pop -> check_tcp
-rwxr-xr-x. 1 root   root   281655 Aug 29 07:30 check_postgres.pl
-rwxr-xr-x. 1 root   root    80817 Aug 29 07:28 check_procs
-rwxr-xr-x  1 nagios users   23327 Aug 29 09:12 check_radius_adv
-rwxr-xr-x. 1 root   root    57100 Aug 29 07:28 check_real
-rwxr-xr-x. 1 root   root     9707 Aug 29 07:28 check_rpc
-rwxr-xr-x. 1 root   root     9232 Aug 29 07:30 check_rrdtraf
-rwxr-xr-x. 1 root   root     5299 Aug 29 07:30 check_rrdtraf.php
-rwxr-xr-x. 1 root   root     1176 Aug 29 07:28 check_sensors
lrwxrwxrwx. 1 root   root        9 Aug 29 07:28 check_simap -> check_tcp
-rwxr-xr-x. 1 root   root     7599 Aug 29 07:30 check_sip
-rwxr-xr-x. 1 root   root   119329 Aug 29 07:28 check_smtp
-rwxr-xr-x  1 nagios users   20226 Aug 29 08:57 check_smtp_send
-rwxr-xr-x  1 nagios users   10440 Aug 29 08:57 check_smtp_send_epn
-rwxr-xr-x. 1 root   root   119321 Aug 29 07:28 check_snmp
-rwxr-xr-x. 1 root   root    10951 Aug 29 07:30 check_snmp_boostedge.pl
-rwxr-xr-x. 1 root   root    17866 Aug 29 07:30 check_snmp_cpfw.pl
-rwxr-xr-x. 1 root   root     8747 Aug 29 07:30 check_snmp_css_main.pl
-rwxr-xr-x. 1 root   root    16786 Aug 29 07:30 check_snmp_css.pl
-rwxr-xr-x. 1 root   root    33562 Aug 29 07:30 check_snmp_env.pl
-rwxr-xr-x  1 nagios users   23464 Dec 19 09:07 check_snmp_generic.pl
-rwxr-xr-x. 1 root   root    31919 Aug 29 07:30 check_snmp_int.pl
-rwxr-xr-x. 1 root   root    10108 Aug 29 07:30 check_snmp_linkproof_nhr.pl
-rwxr-xr-x. 1 root   root    22965 Aug 29 07:30 check_snmp_load.pl
-rwxr-xr-x  1 nagios users   22845 Aug 29 09:02 check_snmp_load_wizard.pl
-rwxr-xr-x. 1 root   root    18734 Aug 29 07:30 check_snmp_mem.pl
-rwxr-xr-x. 1 root   root    11898 Aug 29 07:30 check_snmp_nsbox.pl
-rwxr-xr-x. 1 root   root    24233 Aug 29 07:30 check_snmp_process.pl
-rwxr-xr-x  1 nagios users   26183 Aug 29 09:02 check_snmp_process_wizard.pl
-rwxr-xr-x. 1 root   root    24002 Aug 29 07:30 check_snmp_storage.pl
-rwxr-xr-x  1 nagios users   25484 Aug 29 09:02 check_snmp_storage_wizard.pl
-rwxr-xr-x. 1 root   root    14489 Aug 29 07:30 check_snmp_vrrp.pl
-rwxr-xr-x. 1 root   root    11967 Aug 29 07:30 check_snmp_win.pl
lrwxrwxrwx. 1 root   root        9 Aug 29 07:28 check_spop -> check_tcp
-rwxr-xr-x. 1 root   root    54402 Aug 29 07:28 check_ssh
-rwxr-xr-x  1 nagios users    8333 Aug 29 09:13 check_ssh_expect.pl
lrwxrwxrwx. 1 root   root        9 Aug 29 07:28 check_ssmtp -> check_tcp
-rwxr-xr-x. 1 root   root    61634 Aug 29 07:28 check_swap
-rwxr-xr-x. 1 root   root   105714 Aug 29 07:28 check_tcp
-rwxr-xr-x. 1 root   root    57050 Aug 29 07:28 check_time
lrwxrwxrwx. 1 root   root        9 Aug 29 07:28 check_udp -> check_tcp
-rwxr-xr-x. 1 root   root    67522 Aug 29 07:28 check_ups
-rwxr-xr-x. 1 root   root    56145 Aug 29 07:28 check_users
-rwxr-xr-x. 1 root   root     3019 Aug 29 07:28 check_wave
-rwxr-xr-x. 1 root   root      307 Aug 29 07:30 check_webinject.sh
-rwxr-xr-x  1 nagios users    7065 Aug 29 16:23 check_win_snmp_disk.pl
-rwxr-xr-x  1 nagios users    2405 Jan 20 11:17 check_wmi_plus.conf
-rwxr-xr-x  1 nagios users   46543 Jan 20 11:17 check_wmi_plus.ini
-rwxr-xr-x  1 nagios users  237155 Jan 20 11:17 check_wmi_plus.pl
-rwxr-xr-x. 1 root   root    60559 Aug 29 07:28 negate
-rwxr-xr-x  1 nagios nagios  42724 Dec 19 08:48 process_perfdata.pl
-rwxr-xr-x. 1 root   root    48481 Aug 29 07:30 send_nsca
-rwxr-xr-x. 1 root   root    55590 Aug 29 07:28 urlize
-rwxr-xr-x. 1 root   root     2035 Aug 29 07:28 utils.pm
-rwxr-xr-x. 1 root   root      862 Aug 29 07:28 utils.sh
[root@vnl62 ~]#
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises

Re: Nagios xi performance

Post by scottwilkerson »

This all looks correct.

I think you are going to need to look in a couple directions.

First
Verify that the configuration files have correct information:
Server: /usr/local/nagios/etc/dnxServer.cfg
Client: /usr/local/nagios/etc/dnxClient.cfg

Also make sure from the client you can reach the server's udp port and you don't have a firewall or iptables blocking you.
Former Nagios employee
Creator:
Human Design Website
Get Your Human Design Chart
paul.jobb
Posts: 167
Joined: Tue Aug 02, 2011 4:37 pm

Re: Nagios xi performance

Post by paul.jobb »

I was able to replay a nagiosvm on my desktop and dnxClient seems to start and remain running there, I compared the services and iptables between both and they appear to be identical. When running dnxClient on the affected machine it seems to start and then stop immediately, are there any command line options for /usr/local/nagios/sbin/dnxClient that I might be able to enable for logging as to why it is shutting down?
paul.jobb
Posts: 167
Joined: Tue Aug 02, 2011 4:37 pm

Re: Nagios xi performance

Post by paul.jobb »

it doesn't appear that dnxClient is running on my workstation VM anymore, though I could of swore it was yesterday when I left it, so disregard what I said previously.
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises

Re: Nagios xi performance

Post by scottwilkerson »

I would see if there is anything in

Code: Select all

tail -f /usr/local/nagios/var/log/dnxcld.log
Former Nagios employee
Creator:
Human Design Website
Get Your Human Design Chart
paul.jobb
Posts: 167
Joined: Tue Aug 02, 2011 4:37 pm

Re: Nagios xi performance

Post by paul.jobb »

It appears that dnxclient doesn't want to run on Centos version 6. The earlier version of the xi appliance I had was centos 5.6, which it does start on. I tested on a minimal install of Centos 5.7 and 6.2, dnxclient does run on 5.7 but not 6.2.
paul.jobb
Posts: 167
Joined: Tue Aug 02, 2011 4:37 pm

Re: Nagios xi performance

Post by paul.jobb »

Just an update on this, for whoever is interested, I switched to using mod_gearman instead of DNX. It seems to be more stable and effective for what I need, I was able to distribute pretty well all of the load to my workers/slaves , The install isn't as straight forward as DNX but worth it.