Go to file
Patrick Hemmer 910b726876
Optimize SeriesGrouper & aggregators.merge (#8391)
The previous implementation of SeriesGrouper required breaking a metric object apart into its constituents, converting tags and keys into unoptimized maps, only to have it put them back together into another metric object. This resulted in a significant performance overhead. This overhead was further compounded when the number of fields was large.

This change adds a new AddMetric method to SeriesGrouper which preserves the metric object and removes the back-and-forth conversion.

Additionlly the method used for calculating the metric's hash was switched to use maphash, which is optimized for this case.

----

Benchmarks

Before:

    BenchmarkMergeOne-16          106012	     11790 ns/op
    BenchmarkMergeTwo-16           48529	     24819 ns/op
    BenchmarkGroupID-16           780018	      1608 ns/op

After:

    BenchmarkMergeOne-16          907093	      1173 ns/op
    BenchmarkMergeTwo-16          508321	      2168 ns/op
    BenchmarkGroupID-16         11217788	      99.4 ns/op
2021-01-07 11:39:12 -05:00
.circleci Upgrade circle-ci config to v2.1 (#8621) 2021-01-06 16:23:29 -06:00
.github Update Support.md 2020-08-13 18:39:25 -04:00
agent fix minor agent race condition around error messages (#7999) 2020-08-18 11:27:58 -04:00
cmd/telegraf Add support for once mode; run processors and aggregators during test (#7474) 2020-06-01 15:26:20 -07:00
config Fix tests for Windows - part 1 (#8414) 2020-11-23 10:40:32 -05:00
docs Input SNMP plugin - upgrade gosnmp library to version 1.29.0 (#8588) 2021-01-07 08:44:33 -07:00
etc Update changelog 2020-12-16 16:21:03 -05:00
filter Add test for include/exclude filter (#5193) 2018-12-26 13:15:13 -08:00
internal Input SNMP plugin - upgrade gosnmp library to version 1.29.0 (#8588) 2021-01-07 08:44:33 -07:00
logger Skip logging when logfile is unset (#6648) 2019-11-11 17:03:03 -08:00
metric Optimize SeriesGrouper & aggregators.merge (#8391) 2021-01-07 11:39:12 -05:00
models fix panic on streaming processers using logging (#8176) 2020-09-28 11:58:23 -04:00
plugins Optimize SeriesGrouper & aggregators.merge (#8391) 2021-01-07 11:39:12 -05:00
scripts Upgrade circle-ci config to v2.1 (#8621) 2021-01-06 16:23:29 -06:00
selfstat Fix assorted spelling mistakes (#7507) 2020-05-15 15:43:32 -07:00
testutil changed TestThreadStats acc to wait for 2 and added warning comment (#8592) 2020-12-17 19:32:49 -05:00
.gitattributes Fix tests for Windows - part 1 (#8414) 2020-11-23 10:40:32 -05:00
.gitignore Upgrade circle-ci config to v2.1 (#8621) 2021-01-06 16:23:29 -06:00
.lgtm.yml Lgtm config (#8625) 2020-12-29 14:58:16 -06:00
CHANGELOG.md Update changelog 2020-12-18 17:39:41 -05:00
CONTRIBUTING.md Fix typo in CONTRIBUTING.md (#8528) 2020-12-14 15:36:05 -07:00
EXTERNAL_PLUGINS.md alphabetize external plugins list (#8647) 2021-01-05 11:02:32 -08:00
LICENSE Build packages in makefile (#7759) 2020-06-30 00:15:28 -07:00
Makefile add support for linux/ppc64le (#8432) 2020-11-30 16:58:03 -05:00
README.md New Intel PowerStat input plugin (#8488) 2020-12-10 13:23:27 -07:00
accumulator.go Fix aggregator window and shutdown of multiple aggregators (#5644) 2019-03-29 15:40:33 -07:00
aggregator.go add support for streaming processors (#7634) 2020-06-05 10:43:43 -04:00
appveyor.yml Fix tests for Windows - part 1 (#8414) 2020-11-23 10:40:32 -05:00
build_version.txt Update build version to 1.18.0 2020-12-18 18:32:33 -05:00
docker-compose.yml docs update 2020-12-10 13:21:58 -05:00
go.mod Input SNMP plugin - upgrade gosnmp library to version 1.29.0 (#8588) 2021-01-07 08:44:33 -07:00
go.sum Input SNMP plugin - upgrade gosnmp library to version 1.29.0 (#8588) 2021-01-07 08:44:33 -07:00
input.go add plugin documentation 2020-10-14 12:27:16 -04:00
metric.go Fix spelling errors in comments and documentation (#7492) 2020-05-14 00:41:58 -07:00
output.go add plugin documentation 2020-10-14 12:27:16 -04:00
plugin.go add plugin documentation 2020-10-14 12:27:16 -04:00
processor.go add plugin documentation 2020-10-14 12:27:16 -04:00

README.md

Telegraf Circle CI Docker pulls

Slack Status

Telegraf is an agent for collecting, processing, aggregating, and writing metrics.

Design goals are to have a minimal memory footprint with a plugin system so that developers in the community can easily add support for collecting metrics.

Telegraf is plugin-driven and has the concept of 4 distinct plugin types:

  1. Input Plugins collect metrics from the system, services, or 3rd party APIs
  2. Processor Plugins transform, decorate, and/or filter metrics
  3. Aggregator Plugins create aggregate metrics (e.g. mean, min, max, quantiles, etc.)
  4. Output Plugins write metrics to various destinations

New plugins are designed to be easy to contribute, pull requests are welcomed and we work to incorporate as many pull requests as possible.

Try in Browser 🚀

You can try Telegraf right in your browser in the Telegraf playground.

Contributing

There are many ways to contribute:

Minimum Requirements

Telegraf shares the same minimum requirements as Go:

  • Linux kernel version 2.6.23 or later
  • Windows 7 or later
  • FreeBSD 11.2 or later
  • MacOS 10.11 El Capitan or later

Installation:

You can download the binaries directly from the downloads page or from the releases section.

Ansible Role:

Ansible role: https://github.com/rossmcdonald/telegraf

From Source:

Telegraf requires Go version 1.13 or newer, the Makefile requires GNU make.

  1. Install Go >=1.13 (1.15 recommended)
  2. Clone the Telegraf repository:
    cd ~/src
    git clone https://github.com/influxdata/telegraf.git
    
  3. Run make from the source directory
    cd ~/src/telegraf
    make
    

Changelog

View the changelog for the latest updates and changes by version.

Nightly Builds

These builds are generated from the master branch:

How to use it:

See usage with:

telegraf --help

Generate a telegraf config file:

telegraf config > telegraf.conf

Generate config with only cpu input & influxdb output plugins defined:

telegraf --section-filter agent:inputs:outputs --input-filter cpu --output-filter influxdb config

Run a single telegraf collection, outputting metrics to stdout:

telegraf --config telegraf.conf --test

Run telegraf with all plugins defined in config file:

telegraf --config telegraf.conf

Run telegraf, enabling the cpu & memory input, and influxdb output plugins:

telegraf --config telegraf.conf --input-filter cpu:mem --output-filter influxdb

Documentation

Latest Release Documentation.

For documentation on the latest development code see the documentation index.

Input Plugins

Parsers

Serializers

Processor Plugins

Aggregator Plugins

Output Plugins