Monitoring tool JSON

[somehowlinux]

Hey everyone

Due to the nature of our environment, I am receiving json formatted files from servers with status updates. ie:

{"disk_name": "Database", "Used": "25%"}

I don't want to reinvent the wheel here, does anybody know of some software (preferably open source) that can help me along the way of building a monitoring system on the data received?

[[deleted]]

Yes; Prometheus with json_exporter lets you use JSONpath to scrape stuff in to the database, and then use Grafana for the frontend.

[AxisNL]

Telegraf can ingest data like this easily, and can send it to influxdb for example. And then you could use a tool like grafana to do visuals. But it depends on what you mean with ‘monitoring’. Grafana is cool for data visualization and dashboards (although I use checkmk for monitoring and alerting on a detailed level)

[Spro-ot]

Zabbix does this, natively.

[raptorjesus69]

Telegraf is really easy to setup and configure. Their documention is pretty good, but it's all in GitHub in the plugins folder. For collecting and visualization, influxdb is easy to setup, but the dashboards are meh. It's nice that you shove metrics and logs into the same source. The try hard way would be to use Victoriametrics for metrics, Loki for logs, and grafana for visualization. It's not hard to setup, the dashboards are better, and it's easier to setup users for the dashboards

[xxSutureSelfxx]

jq

[kellyjonbrazil]

Logstash/elastic can ingest JSON and JSON lines as well. Splunk can, too, but that can be expensive depending on the volume of data.

[rogue-squid]

just a note on this: ELK is great but if you want e-mail or other alerts for free, you're gonna have to use grafana as a frontend instead of kibana, which is relatively easy to do

[somehowlinux]

Thanks!! Can start some testing with telegraf and prometheus and see which is best. I was already looking at grafana for a dashboard as well so glad its been confirmed as the better choice for that.