InfluxDB 2.7 is the platform purpose-built to collect, store, process and visualize time series data. Time series data is a sequence of data points indexed in time order. Data points typically consist of successive measurements made from the same source and are used to track changes over time. Examples of time series data include:
- Industrial sensor data
- Server performance metrics
- Heartbeats per minute
- Electrical activity in the brain
- Rainfall measurements
- Stock prices
This multi-part tutorial walks you through writing time series data to InfluxDB 2.7, querying that data, processing and alerting on the data, and then visualizing the data.
Columnar time-series database with high performance ingestion and SQL analytics you know and love from QuestDB open source, now on the cloud.
Fluent Bit is an open source and multi-platform Log Processor and Forwarder which allows you to collect data/logs from different sources, unify and send them to multiple destinations. It's fully compatible with Docker and Kubernetes environments.
Fluent Bit is written in C, have a pluggable architecture supporting around 30 extensions. It's fast and lightweight and provide the required security for network operations through TLS.
As a follow-up evolution of this project we wanted something more flexible, with better detail, and also able to collect statistics from 7-Mode NetApps(OCPM is compatible with cDOTs only). Enter NetApp Harvest, a collection of Perl scripts provided by NetApp that collect a lot of statistics from 7-Modes, cDOTs and OCUMs, and send them to Graphite(and thanks to InfluxDB's "graphite compatibility mode", to InfluxDB as well). NetApp harvest is extremely flexible, you can add stuff you want to get data on and you can also change the frequence(by default it runs every minute - much better than OCPM's unchangable 5min).
In order for InfluxDB to be able to parse all that data, it needs templates, and in that case, the templates are pretty complicated.
Prerequisites
NetApp Harvest - you can download it from NetApp's website, along with a really nice and detailed installation guide
InfluxDB 0.13+
Grafana 3+