statistics on multiple fields

This support forum board is for support questions relating to Nagios Log Server, our solution for managing and monitoring critical log data.
_asp_
Posts: 91
Joined: Mon May 23, 2016 4:30 am

statistics on multiple fields

Post by _asp_ »

Hi,

I have multiple requests parsed like this:

Code: Select all

{
  "_index": "logstash-2016.06.16",
  "_type": "import_json",
  "_id": "AVVZOMg0IfQq8Alkg2vK",
  "_score": null,
  "_source": {
    "EventReceivedTime": "2016-06-16 14:39:01",
    "SourceModuleName": "remote_download_statistics_1_qa",
    "SourceModuleType": "im_file",
    "Component": "HL_RemoteDownload",
    "Application": "DB_RemoteDownload_Stat_1",
    "Stage": "QA",
    "HostName": "jumpserver",
    "ServerType": "Jump",
    "@version": "1",
    "@timestamp": "2016-06-16T12:38:50.000Z",
    "host": "212.31.93.40",
    "type": "import_json",
    "tags": [
      "is_MSD",
      "is_manual"
    ],
    "do_id": 125165,
    "customer": "Feld",
    "tm_id": 15286,
    "do_time_interval": 16968,
    "currentStatus": 31,
    "time_diff_phase_pending": 87,
    "time_diff_phase_all": 480,
    "timestamp_status_created": "2016-06-16T12:30:50.000Z",
    "timestamp_status_auth_start": "2016-06-16T12:32:17.000Z",
    "timestamp_status_end": "2016-06-16T12:38:50.000Z"
  },
  "highlight": {
    "Application": [
      "@start-highlight@DB_RemoteDownload_Stat_1@end-highlight@"
    ]
  },
  "sort": [
    1466080730000,
    1466080730000
  ]
}
We have a process which first is pending, then processed and then finished somewhen. The logs give me the information how long a phase of the processing took which are stored in following fields:
"time_diff_phase_pending": 87, -> order was pending for 87seconds
"time_diff_phase_all": 480, -> order was finished after 480s.

Now I have many of these events in elasticsearch and I want to show the following information in a dashboard:

- min / max / mean value of "time_diff_phase_pending"
- min / max / mean value of "time_diff_phase_all"

I'd like the overview of the stats panel, but i dont't know how to show different fields on each row.

Workaround might be using multiple stats panels, but this is wasting space.

Thanks, Andreas
User avatar
hsmith
Agent Smith
Posts: 3539
Joined: Thu Jul 30, 2015 11:09 am
Location: 127.0.0.1

Re: statistics on multiple fields

Post by hsmith »

You're saying you want some sort of graph, like multi stacked or color coded, showing different values on different lines/colors/something similar? Just making sure I understand correctly.
Former Nagios Employee.
me.
_asp_
Posts: 91
Joined: Mon May 23, 2016 4:30 am

Re: statistics on multiple fields

Post by _asp_ »

currently my workaround which is taking much space on the dashboard looks like this:
workaround.JPG
I have two stat panels, going on the same query (which is capturing my events).

the left one is generating stats on field "time_diff_phase_pending", the other one on "time_diff_phase_all".
both fields are integers.

I would like to show both information as separate lines in a stats panel like this (but here i have different queries but the same field):
target.jpg
You do not have the required permissions to view the files attached to this post.
User avatar
hsmith
Agent Smith
Posts: 3539
Joined: Thu Jul 30, 2015 11:09 am
Location: 127.0.0.1

Re: statistics on multiple fields

Post by hsmith »

I can put in a feature request if you'd like.

The ability to add portions of multiple tables to a single panel is what you'd like to see?
Former Nagios Employee.
me.
_asp_
Posts: 91
Joined: Mon May 23, 2016 4:30 am

Re: statistics on multiple fields

Post by _asp_ »

I don't know If I get you correctly.

I would name it the following.

Currently what we can do is to show statistics of multiple but for one single field in a stats panel.
What I want to do is using the same query but different / multiple fields for statistical operation in one stats panel.
Being able to use also multiple query would also be fine.

I think you can bring it down to the following:

One line in a stat panel should be defined by query and value field.
I would like to set up multiple independent definitions (as stated above) for the same stat panel.

Thanks, Andreas.

PS: yes, creating a feature request would be nice.
User avatar
hsmith
Agent Smith
Posts: 3539
Joined: Thu Jul 30, 2015 11:09 am
Location: 127.0.0.1

Re: statistics on multiple fields

Post by hsmith »

Feature request 8855 has been submitted.
Former Nagios Employee.
me.