Just to verify, do the slave machines have the following plugin?
/usr/local/nagios/libexec/check_wmi_plus.pl
If so, what are the permissions on it?
Nagios xi performance
-
- Posts: 167
- Joined: Tue Aug 02, 2011 4:37 pm
Re: Nagios xi performance
they do, I did test running the check_wmi_plus script from the command line of the slave machine and it did work. I am also getting failures on my ping tests
[Wed Feb 1 14:20:43.203 2012] Service handler received service check [26] at 1328131243.
[Wed Feb 1 14:20:43.203 2012] Allocating node request.
[Wed Feb 1 14:20:43.203 2012] dnxGetNodeRequest: Unable to fulfill node request: Resource was not found.
[Wed Feb 1 14:20:43.203 2012] Post failed: Resource was not found. Service check [26] will execute locally: /usr/local/nagios/libexec/check_icmp -H 999.999.81.35 -w 3000.0,80% -c 5000.0,100% -p 5.
The slave machines are the same xi vm appliances that I downloaded and am using for the dnx master (2011R1.9)
I seem to recall when I installed the DNX server that it prompted for a password for the 'nagios' account on the slaves, that script indicated the password by default was 'welcome'. I couldn't find the default pw in the documenation for those machines so I did reset them to use welcome.
[Wed Feb 1 14:20:43.203 2012] Service handler received service check [26] at 1328131243.
[Wed Feb 1 14:20:43.203 2012] Allocating node request.
[Wed Feb 1 14:20:43.203 2012] dnxGetNodeRequest: Unable to fulfill node request: Resource was not found.
[Wed Feb 1 14:20:43.203 2012] Post failed: Resource was not found. Service check [26] will execute locally: /usr/local/nagios/libexec/check_icmp -H 999.999.81.35 -w 3000.0,80% -c 5000.0,100% -p 5.
The slave machines are the same xi vm appliances that I downloaded and am using for the dnx master (2011R1.9)
I seem to recall when I installed the DNX server that it prompted for a password for the 'nagios' account on the slaves, that script indicated the password by default was 'welcome'. I couldn't find the default pw in the documenation for those machines so I did reset them to use welcome.
-
- DevOps Engineer
- Posts: 19396
- Joined: Tue Nov 15, 2011 3:11 pm
- Location: Nagios Enterprises
Re: Nagios xi performance
It still could be a permissions issue.paul.jobb wrote:they do, I did test running the check_wmi_plus script from the command line of the slave machine and it did work. I am also getting failures on my ping tests
On the slave machine can you run
Code: Select all
ls -l /usr/local/nagios/libexec
-
- Posts: 167
- Joined: Tue Aug 02, 2011 4:37 pm
Re: Nagios xi performance
Code: Select all
[root@vnl62 ~]# ls -l /usr/local/nagios/libexec
total 4512
-rwxr-xr-x. 1 root root 65068 Aug 29 07:28 check_apt
-rwxr-xr-x. 1 root root 6897 Aug 29 07:30 check_asterisk.pl
-rwxr-xr-x 1 nagios users 4173 Oct 31 13:58 check_bl
-rwxr-xr-x 1 nagios users 2289 Aug 29 08:55 check_bpi.php
-rwxr-xr-x. 1 root root 2274 Aug 29 07:28 check_breeze
lrwxrwxrwx. 1 root root 9 Aug 29 07:28 check_clamd -> check_tcp
-rwxr-xr-x. 1 root root 40575 Aug 29 07:28 check_cluster
-r-sr-xr-x. 1 root root 73301 Aug 29 07:28 check_dhcp
-rwxr-xr-x. 1 root root 71777 Aug 29 07:28 check_dig
-rwxr-xr-x. 1 root root 101991 Aug 29 07:28 check_disk
-rwxr-xr-x. 1 root root 8163 Aug 29 07:28 check_disk_smb
-rwxr-xr-x. 1 root root 79570 Aug 29 07:28 check_dns
-rwxr-xr-x. 1 root root 36412 Aug 29 07:28 check_dummy
-rwxr-xr-x 1 nagios users 5625 Aug 29 08:59 check_em01.pl
-rwxr-xr-x 1 nagios users 38345 Aug 29 08:57 check_email_delivery
-rwxr-xr-x 1 nagios users 20511 Aug 29 08:57 check_email_delivery_epn
-rwxr-xr-x. 1 root root 20039 Aug 29 07:30 check_email_loop.pl
-rwxr-xr-x. 1 root root 3143 Aug 29 07:28 check_file_age
-rwxr-xr-x. 1 root root 6395 Aug 29 07:28 check_flexlm
-rwxr-xr-x. 1 root root 74960 Aug 29 07:28 check_fping
lrwxrwxrwx. 1 root root 9 Aug 29 07:28 check_ftp -> check_tcp
-rwxr-xr-x 1 nagios users 3437 Aug 29 09:00 check_ftp_fully
-rwxr-xr-x. 1 root root 73830 Aug 29 07:28 check_hpjd
-rwxr-xr-x. 1 root root 171978 Aug 29 07:28 check_http
-r-sr-xr-x. 1 root root 80061 Aug 29 07:28 check_icmp
-rwxr-xr-x. 1 root root 47064 Aug 29 07:28 check_ide_smart
-rwxr-xr-x. 1 root root 15310 Aug 29 07:28 check_ifoperstatus
-rwxr-xr-x. 1 root root 12853 Aug 29 07:28 check_ifstatus
lrwxrwxrwx. 1 root root 9 Aug 29 07:28 check_imap -> check_tcp
-rwxr-xr-x 1 nagios users 35413 Aug 29 08:57 check_imap_receive
-rwxr-xr-x 1 nagios users 15576 Aug 29 08:57 check_imap_receive_epn
-rwxr-xr-x. 1 root root 7429 Aug 29 07:28 check_ircd
lrwxrwxrwx. 1 root root 9 Aug 29 07:28 check_jabber -> check_tcp
-rwxr-xr-x. 1 root root 59134 Aug 29 07:28 check_ldap
lrwxrwxrwx. 1 root root 10 Aug 29 07:28 check_ldaps -> check_ldap
-rwxr-xr-x. 1 root root 59194 Aug 29 07:28 check_load
-rwxr-xr-x. 1 root root 6062 Aug 29 07:28 check_log
-rwxr-xr-x. 1 root root 20367 Aug 29 07:28 check_mailq
-rwxr-xr-x. 1 root root 47300 Aug 29 07:28 check_mrtg
-rwxr-xr-x. 1 root root 46703 Aug 29 07:28 check_mrtgtraf
-rwxr-xr-x. 1 root root 11427 Aug 29 07:30 check_mssql
-rwxr-xr-x 1 nagios users 11625 Dec 19 09:07 check_mssql_database.py
-rwxr-xr-x 1 nagios users 17550 Dec 19 09:07 check_mssql_server.py
-rwxr-xr-x. 1 root root 78008 Aug 29 07:28 check_mysql
-rwxr-xr-x. 1 root root 98711 Aug 29 07:30 check_mysql_health
-rwxr-xr-x. 1 root root 71648 Aug 29 07:28 check_mysql_query
-rwxr-xr-x. 1 root root 59417 Aug 29 07:28 check_nagios
-rwxr-xr-x 1 nagios users 6364 Aug 29 09:07 check_nagios_performance.php
-rwxr-xr-x 1 nagios users 17209 Dec 19 09:07 check_nagiosxiserver.php
lrwxrwxrwx. 1 root root 9 Aug 29 07:28 check_nntp -> check_tcp
lrwxrwxrwx. 1 root root 9 Aug 29 07:28 check_nntps -> check_tcp
-rwxrwxr-x. 1 nagios nagios 69216 Aug 29 07:30 check_nrpe
-rwxr-xr-x. 1 root root 74851 Aug 29 07:28 check_nt
-rwxr-xr-x. 1 root root 76550 Aug 29 07:28 check_ntp
-rwxr-xr-x. 1 root root 68987 Aug 29 07:28 check_ntp_peer
-rwxr-xr-x. 1 root root 66180 Aug 29 07:28 check_ntp_time
-rwxr-xr-x. 1 root root 102418 Aug 29 07:28 check_nwstat
-rwxr-xr-x. 1 root root 8366 Aug 29 07:28 check_oracle
-rwxr-xr-x. 1 root root 60153 Aug 29 07:28 check_overcr
-rwxr-xr-x. 1 root root 55894 Aug 29 07:28 check_pgsql
-rwxr-xr-x. 1 root root 80896 Aug 29 07:28 check_ping
-rwxr-xr-x 1 nagios nagios 6183 Dec 19 08:48 check_pnp_rrds.pl
lrwxrwxrwx. 1 root root 9 Aug 29 07:28 check_pop -> check_tcp
-rwxr-xr-x. 1 root root 281655 Aug 29 07:30 check_postgres.pl
-rwxr-xr-x. 1 root root 80817 Aug 29 07:28 check_procs
-rwxr-xr-x 1 nagios users 23327 Aug 29 09:12 check_radius_adv
-rwxr-xr-x. 1 root root 57100 Aug 29 07:28 check_real
-rwxr-xr-x. 1 root root 9707 Aug 29 07:28 check_rpc
-rwxr-xr-x. 1 root root 9232 Aug 29 07:30 check_rrdtraf
-rwxr-xr-x. 1 root root 5299 Aug 29 07:30 check_rrdtraf.php
-rwxr-xr-x. 1 root root 1176 Aug 29 07:28 check_sensors
lrwxrwxrwx. 1 root root 9 Aug 29 07:28 check_simap -> check_tcp
-rwxr-xr-x. 1 root root 7599 Aug 29 07:30 check_sip
-rwxr-xr-x. 1 root root 119329 Aug 29 07:28 check_smtp
-rwxr-xr-x 1 nagios users 20226 Aug 29 08:57 check_smtp_send
-rwxr-xr-x 1 nagios users 10440 Aug 29 08:57 check_smtp_send_epn
-rwxr-xr-x. 1 root root 119321 Aug 29 07:28 check_snmp
-rwxr-xr-x. 1 root root 10951 Aug 29 07:30 check_snmp_boostedge.pl
-rwxr-xr-x. 1 root root 17866 Aug 29 07:30 check_snmp_cpfw.pl
-rwxr-xr-x. 1 root root 8747 Aug 29 07:30 check_snmp_css_main.pl
-rwxr-xr-x. 1 root root 16786 Aug 29 07:30 check_snmp_css.pl
-rwxr-xr-x. 1 root root 33562 Aug 29 07:30 check_snmp_env.pl
-rwxr-xr-x 1 nagios users 23464 Dec 19 09:07 check_snmp_generic.pl
-rwxr-xr-x. 1 root root 31919 Aug 29 07:30 check_snmp_int.pl
-rwxr-xr-x. 1 root root 10108 Aug 29 07:30 check_snmp_linkproof_nhr.pl
-rwxr-xr-x. 1 root root 22965 Aug 29 07:30 check_snmp_load.pl
-rwxr-xr-x 1 nagios users 22845 Aug 29 09:02 check_snmp_load_wizard.pl
-rwxr-xr-x. 1 root root 18734 Aug 29 07:30 check_snmp_mem.pl
-rwxr-xr-x. 1 root root 11898 Aug 29 07:30 check_snmp_nsbox.pl
-rwxr-xr-x. 1 root root 24233 Aug 29 07:30 check_snmp_process.pl
-rwxr-xr-x 1 nagios users 26183 Aug 29 09:02 check_snmp_process_wizard.pl
-rwxr-xr-x. 1 root root 24002 Aug 29 07:30 check_snmp_storage.pl
-rwxr-xr-x 1 nagios users 25484 Aug 29 09:02 check_snmp_storage_wizard.pl
-rwxr-xr-x. 1 root root 14489 Aug 29 07:30 check_snmp_vrrp.pl
-rwxr-xr-x. 1 root root 11967 Aug 29 07:30 check_snmp_win.pl
lrwxrwxrwx. 1 root root 9 Aug 29 07:28 check_spop -> check_tcp
-rwxr-xr-x. 1 root root 54402 Aug 29 07:28 check_ssh
-rwxr-xr-x 1 nagios users 8333 Aug 29 09:13 check_ssh_expect.pl
lrwxrwxrwx. 1 root root 9 Aug 29 07:28 check_ssmtp -> check_tcp
-rwxr-xr-x. 1 root root 61634 Aug 29 07:28 check_swap
-rwxr-xr-x. 1 root root 105714 Aug 29 07:28 check_tcp
-rwxr-xr-x. 1 root root 57050 Aug 29 07:28 check_time
lrwxrwxrwx. 1 root root 9 Aug 29 07:28 check_udp -> check_tcp
-rwxr-xr-x. 1 root root 67522 Aug 29 07:28 check_ups
-rwxr-xr-x. 1 root root 56145 Aug 29 07:28 check_users
-rwxr-xr-x. 1 root root 3019 Aug 29 07:28 check_wave
-rwxr-xr-x. 1 root root 307 Aug 29 07:30 check_webinject.sh
-rwxr-xr-x 1 nagios users 7065 Aug 29 16:23 check_win_snmp_disk.pl
-rwxr-xr-x 1 nagios users 2405 Jan 20 11:17 check_wmi_plus.conf
-rwxr-xr-x 1 nagios users 46543 Jan 20 11:17 check_wmi_plus.ini
-rwxr-xr-x 1 nagios users 237155 Jan 20 11:17 check_wmi_plus.pl
-rwxr-xr-x. 1 root root 60559 Aug 29 07:28 negate
-rwxr-xr-x 1 nagios nagios 42724 Dec 19 08:48 process_perfdata.pl
-rwxr-xr-x. 1 root root 48481 Aug 29 07:30 send_nsca
-rwxr-xr-x. 1 root root 55590 Aug 29 07:28 urlize
-rwxr-xr-x. 1 root root 2035 Aug 29 07:28 utils.pm
-rwxr-xr-x. 1 root root 862 Aug 29 07:28 utils.sh
[root@vnl62 ~]#
-
- DevOps Engineer
- Posts: 19396
- Joined: Tue Nov 15, 2011 3:11 pm
- Location: Nagios Enterprises
Re: Nagios xi performance
This all looks correct.
I think you are going to need to look in a couple directions.
First
Verify that the configuration files have correct information:
Server: /usr/local/nagios/etc/dnxServer.cfg
Client: /usr/local/nagios/etc/dnxClient.cfg
Also make sure from the client you can reach the server's udp port and you don't have a firewall or iptables blocking you.
I think you are going to need to look in a couple directions.
First
Verify that the configuration files have correct information:
Server: /usr/local/nagios/etc/dnxServer.cfg
Client: /usr/local/nagios/etc/dnxClient.cfg
Also make sure from the client you can reach the server's udp port and you don't have a firewall or iptables blocking you.
-
- Posts: 167
- Joined: Tue Aug 02, 2011 4:37 pm
Re: Nagios xi performance
I was able to replay a nagiosvm on my desktop and dnxClient seems to start and remain running there, I compared the services and iptables between both and they appear to be identical. When running dnxClient on the affected machine it seems to start and then stop immediately, are there any command line options for /usr/local/nagios/sbin/dnxClient that I might be able to enable for logging as to why it is shutting down?
-
- Posts: 167
- Joined: Tue Aug 02, 2011 4:37 pm
Re: Nagios xi performance
it doesn't appear that dnxClient is running on my workstation VM anymore, though I could of swore it was yesterday when I left it, so disregard what I said previously.
-
- DevOps Engineer
- Posts: 19396
- Joined: Tue Nov 15, 2011 3:11 pm
- Location: Nagios Enterprises
Re: Nagios xi performance
I would see if there is anything in
Code: Select all
tail -f /usr/local/nagios/var/log/dnxcld.log
-
- Posts: 167
- Joined: Tue Aug 02, 2011 4:37 pm
Re: Nagios xi performance
It appears that dnxclient doesn't want to run on Centos version 6. The earlier version of the xi appliance I had was centos 5.6, which it does start on. I tested on a minimal install of Centos 5.7 and 6.2, dnxclient does run on 5.7 but not 6.2.
-
- Posts: 167
- Joined: Tue Aug 02, 2011 4:37 pm
Re: Nagios xi performance
Just an update on this, for whoever is interested, I switched to using mod_gearman instead of DNX. It seems to be more stable and effective for what I need, I was able to distribute pretty well all of the load to my workers/slaves , The install isn't as straight forward as DNX but worth it.