check_snmp, performance graph and graph explorer discrepancy

This support forum board is for support questions relating to Nagios XI, our flagship commercial network monitoring solution.
User avatar
tgriep
Madmin
Posts: 9190
Joined: Thu Oct 30, 2014 9:02 am

Re: check_snmp, performance graph and graph explorer discrep

Post by tgriep »

Are the active sessions always zero when they are polled?
Be sure to check out our Knowledgebase for helpful articles and solutions!
iptribe
Posts: 52
Joined: Sun Aug 31, 2014 11:03 am

Re: check_snmp, performance graph and graph explorer discrep

Post by iptribe »

tgriep wrote:Are the active sessions always zero when they are polled?
No, they are not always zero. Please see below.
4.PNG
You do not have the required permissions to view the files attached to this post.
User avatar
tgriep
Madmin
Posts: 9190
Joined: Thu Oct 30, 2014 9:02 am

Re: check_snmp, performance graph and graph explorer discrep

Post by tgriep »

The check_snmp_gauge.cfg file may have been corrupted when I uploaded it last week.
I replaced it with a new copy so could you re-download it to your Nagios system, delete the rrd and xml files and see if that resolves it.
Be sure to check out our Knowledgebase for helpful articles and solutions!
iptribe
Posts: 52
Joined: Sun Aug 31, 2014 11:03 am

Re: check_snmp, performance graph and graph explorer discrep

Post by iptribe »

tgriep wrote:The check_snmp_gauge.cfg file may have been corrupted when I uploaded it last week.
I replaced it with a new copy so could you re-download it to your Nagios system, delete the rrd and xml files and see if that resolves it.
Is it the same check_snmp_gauge.cfg file attached in previous page? I have re-downloaded it and deleted the rrd and xml files. New graph generated but still with the same data.
User avatar
tgriep
Madmin
Posts: 9190
Joined: Thu Oct 30, 2014 9:02 am

Re: check_snmp, performance graph and graph explorer discrep

Post by tgriep »

Yes, the file from the previous page is good. I deleted the bad one and uploaded a good copy. Now to trouble shooting.

Edit this file /usr/local/nagios/etc/pnp/process_perfdata.cfg
Change this from

Code: Select all

LOG_LEVEL = 0
to

Code: Select all

LOG_LEVEL = 3
Save the changes and run the following in a shell.

Code: Select all

tail -f /usr/local/nagios/var/perfdata.log
Delete the RRD and XML file again and schedule an immediate check of that service 3 times and upload the output of the tail command.
Please upload it as a txt file as it will be quite large.

After that, you can put the LOG_LEVEL back to 0.
Be sure to check out our Knowledgebase for helpful articles and solutions!
iptribe
Posts: 52
Joined: Sun Aug 31, 2014 11:03 am

Re: check_snmp, performance graph and graph explorer discrep

Post by iptribe »

Please see the attached logs.
Nagios-01_2015-07-30_11-18-39.log
I have 3 servers having the same issue with Active Sessions service graph.

RCS-PROD-SSC-01, RCS-PROD-SSC-02 and RCS-PROD-SSC-03.
You do not have the required permissions to view the files attached to this post.
User avatar
tgriep
Madmin
Posts: 9190
Joined: Thu Oct 30, 2014 9:02 am

Re: check_snmp, performance graph and graph explorer discrep

Post by tgriep »

The log file didn't show that the check used the check_snmp_gauge template.
Can you edit that service and remove the service template "check_xi_service_snmp" that is assigned to the service?
Can you post how that service is defined?
Go in to Core Config Manager > Service and find that service and click on the Floppy icon for that service copy and paste the configuration in code wraps here?

Can you run the following and post the output here?

Code: Select all

ll /usr/local/nagios/etc/pnp/check_commands/
ll /usr/local/nagios/share/perfdata/RCS-PROD-SSC-01
Can you change to this folder
/usr/local/nagios/share/perfdata/RCS-PROD-SSC-01
Run the rrdtool on the Active Session rrd file like below and post back the top 15 lines?

Code: Select all

rrdtool info filename.rrd
Be sure to check out our Knowledgebase for helpful articles and solutions!
iptribe
Posts: 52
Joined: Sun Aug 31, 2014 11:03 am

Re: check_snmp, performance graph and graph explorer discrep

Post by iptribe »

tgriep wrote:The log file didn't show that the check used the check_snmp_gauge template.
Can you edit that service and remove the service template "check_xi_service_snmp" that is assigned to the service?
Can you post how that service is defined?
Go in to Core Config Manager > Service and find that service and click on the Floppy icon for that service copy and paste the configuration in code wraps here?
###############################################################################
#
# Service configuration file
#
# Created by: Nagios QL Version 3.0.3
# Date: 2015-08-03 15:55:11
# Version: Nagios 3.x config file
#
# --- DO NOT EDIT THIS FILE BY HAND ---
# Nagios QL will overwite all manual settings during the next update
#
###############################################################################

define service {
host_name RCS-PROD-SSC-01,RCS-PROD-SSC-02,RCS-PROD-SSC-03,RCS-STAGE-SSC-01
service_description Active Sessions
check_command check_snmp_gauge!-P 2c -C public -o globalStatActiveCalls.summaryPeriod1Current5Minutes -m /usr/share/snmp/mibs/perimeta.mib -c 10000 -l ActiveCalls!!!!!!!
initial_state u
max_check_attempts 10
check_interval 5
retry_interval 10
active_checks_enabled 1
check_period 24x7
event_handler xi_service_event_handler
register 1
}

###############################################################################
#
# Service configuration file
#
# END OF FILE
#
###############################################################################
Can you run the following and post the output here?

Code: Select all

ll /usr/local/nagios/etc/pnp/check_commands/
ll /usr/local/nagios/share/perfdata/RCS-PROD-SSC-01
$ ll /usr/local/nagios/etc/pnp/check_commands/
total 8
-rw-rw-r-- 1 apache nagios 755 Aug 14 2014 check_nwstat.cfg-sample
-rw-rw-rw- 1 apache nagios 752 Jul 29 10:30 check_snmp_gauge.cfg

$ ll /usr/local/nagios/share/perfdata/RCS-PROD-SSC-01
total 3024
-rwxrwxr-x 1 nagios nagios 384952 Aug 3 15:48 Active_Sessions.rrd
-rw-rw-rw- 1 nagios nagios 2545 Aug 3 15:48 Active_Sessions.xml
-rwxrwxr-x 1 nagios nagios 384952 Aug 3 15:49 CPU_usage_on_SBC_Nodes.rrd
-rw-rw-rw- 1 nagios nagios 2640 Aug 3 15:49 CPU_usage_on_SBC_Nodes.xml
-rwxrwxr-x. 1 nagios nagios 1534768 Sep 16 2014 _HOST_.rrd
-rwxrwxr-x 1 nagios nagios 4020 Sep 16 2014 _HOST_.xml
-rwxrwxr-x 1 nagios nagios 384952 Aug 3 15:47 Memory_Usage_on_SSC_Nodes.rrd
-rw-rw-rw- 1 nagios nagios 2606 Aug 3 15:47 Memory_Usage_on_SSC_Nodes.xml
-rwxrwxr-x 1 nagios nagios 384952 Aug 3 15:50 Number_of_Registered_Subscribers.rrd
-rw-rw-rw- 1 nagios nagios 2700 Aug 3 15:50 Number_of_Registered_Subscribers.xml

Can you change to this folder
/usr/local/nagios/share/perfdata/RCS-PROD-SSC-01
Run the rrdtool on the Active Session rrd file like below and post back the top 15 lines?

Code: Select all

rrdtool info filename.rrd
$ rrdtool info Active_Sessions.rrd
filename = "Active_Sessions.rrd"
rrd_version = "0003"
step = 60
last_update = 1438588083
ds[1].type = "GAUGE"
ds[1].minimal_heartbeat = 8460
ds[1].min = NaN
ds[1].max = NaN
ds[1].last_ds = "4"
ds[1].value = 1.2000000000e+01
ds[1].unknown_sec = 0
rra[0].cf = "AVERAGE"
rra[0].rows = 2880
rra[0].cur_row = 1273
rra[0].pdp_per_row = 1
rra[0].xff = 5.0000000000e-01
rra[0].cdp_prep[0].value = NaN
rra[0].cdp_prep[0].unknown_datapoints = 0
rra[1].cf = "AVERAGE"
rra[1].rows = 2880
rra[1].cur_row = 761
rra[1].pdp_per_row = 5
rra[1].xff = 5.0000000000e-01
rra[1].cdp_prep[0].value = 1.1970000000e+01
rra[1].cdp_prep[0].unknown_datapoints = 0
rra[2].cf = "AVERAGE"
rra[2].rows = 4320
rra[2].cur_row = 353
rra[2].pdp_per_row = 30
rra[2].xff = 5.0000000000e-01
rra[2].cdp_prep[0].value = 5.9900000000e+01
rra[2].cdp_prep[0].unknown_datapoints = 0
rra[3].cf = "AVERAGE"
rra[3].rows = 5840
rra[3].cur_row = 379
rra[3].pdp_per_row = 360
rra[3].xff = 5.0000000000e-01
rra[3].cdp_prep[0].value = 2.0420000000e+02
rra[3].cdp_prep[0].unknown_datapoints = 0
rra[4].cf = "MAX"
rra[4].rows = 2880
rra[4].cur_row = 805
rra[4].pdp_per_row = 1
rra[4].xff = 5.0000000000e-01
rra[4].cdp_prep[0].value = NaN
rra[4].cdp_prep[0].unknown_datapoints = 0
rra[5].cf = "MAX"
rra[5].rows = 2880
rra[5].cur_row = 979
rra[5].pdp_per_row = 5
rra[5].xff = 5.0000000000e-01
rra[5].cdp_prep[0].value = 3.9900000000e+00
rra[5].cdp_prep[0].unknown_datapoints = 0
rra[6].cf = "MAX"
rra[6].rows = 4320
rra[6].cur_row = 3518
rra[6].pdp_per_row = 30
rra[6].xff = 5.0000000000e-01
rra[6].cdp_prep[0].value = 4.9500000000e+00
rra[6].cdp_prep[0].unknown_datapoints = 0
rra[7].cf = "MAX"
rra[7].rows = 5840
rra[7].cur_row = 1335
rra[7].pdp_per_row = 360
rra[7].xff = 5.0000000000e-01
rra[7].cdp_prep[0].value = 4.9533333333e+00
rra[7].cdp_prep[0].unknown_datapoints = 0
rra[8].cf = "MIN"
rra[8].rows = 2880
rra[8].cur_row = 1833
rra[8].pdp_per_row = 1
rra[8].xff = 5.0000000000e-01
rra[8].cdp_prep[0].value = NaN
rra[8].cdp_prep[0].unknown_datapoints = 0
rra[9].cf = "MIN"
rra[9].rows = 2880
rra[9].cur_row = 21
rra[9].pdp_per_row = 5
rra[9].xff = 5.0000000000e-01
rra[9].cdp_prep[0].value = 3.9900000000e+00
rra[9].cdp_prep[0].unknown_datapoints = 0
rra[10].cf = "MIN"
rra[10].rows = 4320
rra[10].cur_row = 2451
rra[10].pdp_per_row = 30
rra[10].xff = 5.0000000000e-01
rra[10].cdp_prep[0].value = 2.0300000000e+00
rra[10].cdp_prep[0].unknown_datapoints = 0
rra[11].cf = "MIN"
rra[11].rows = 5840
rra[11].cur_row = 2758
rra[11].pdp_per_row = 360
rra[11].xff = 5.0000000000e-01
rra[11].cdp_prep[0].value = 0.0000000000e+00
rra[11].cdp_prep[0].unknown_datapoints = 0
User avatar
tgriep
Madmin
Posts: 9190
Joined: Thu Oct 30, 2014 9:02 am

Re: check_snmp, performance graph and graph explorer discrep

Post by tgriep »

So far the settings look like they should work.
Can you upload the /usr/share/snmp/mibs/perimeta.mib, and the rrd and xml files to this post?
Be sure to check out our Knowledgebase for helpful articles and solutions!
iptribe
Posts: 52
Joined: Sun Aug 31, 2014 11:03 am

Re: check_snmp, performance graph and graph explorer discrep

Post by iptribe »

tgriep wrote:So far the settings look like they should work.
Can you upload the /usr/share/snmp/mibs/perimeta.mib, and the rrd and xml files to this post?
Hi, please see the attached files.
ActiveSessions.zip
You do not have the required permissions to view the files attached to this post.