CL-Softwares
/
telegraf
8
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,934 Commits 2 Branches 0 Tags 68 MiB
Commit Graph

59 Commits

Author SHA1 Message Date
Anton Belousov 5ab2468789
feat(inputs.kafka_consumer): Add message headers as metric tags. (#13924) 2023-09-20 12:53:18 +02:00
Tobias Jungel 3fae6439ab
fix(inputs.kafka_consumer): Use per-message parser to avoid races (#13886) 2023-09-11 08:18:51 -06:00
Joshua Powers 9f83bee8ef
Revert "feat(inputs.kafka_consumer): Refresh regexp topics periodically (#13410)" (#13617) 
This reverts commit a13f3463eb.
 2023-07-14 16:06:45 +02:00
Adam Thornton a13f3463eb
feat(inputs.kafka_consumer): Refresh regexp topics periodically (#13410) 2023-07-07 10:45:37 -06:00
Sven Rebhan 7ced2606b2
chore(parsers)!: Remove old-style creation (#13310) 2023-05-23 14:17:11 -06:00
Adam Thornton 8762c71e65
feat(inputs.kafka_consumer): Add regular expression support for topics (#11831) 2023-05-23 12:08:01 -06:00
Paweł Żak 00347033ab
chore: Fix linter findings for nolintlint (part2) (#12430) 
Co-authored-by: Pawel Zak <Pawel Zak>
 2023-01-26 11:27:32 +01:00
Trevor North 70b33c2649
feat(inputs.kafka_consumer): Add sarama debug logs (#12304) 2022-12-05 21:54:08 +01:00
reimda 494f558b4e
feat: Add exponential backoff when connecting or reconnecting and allow plugin to start without making initial connection (#12111) 2022-11-03 08:01:22 -05:00
reimda 7d9f09ddc8
chore: add kafka round trip integration test using inputs.kafka_consumer and outputs.kafka (#12058) 2022-10-25 07:50:59 -06:00
reimda a6352d9794
fix(inputs.kafka): switch to sarama's new consumer group rebalance strategy setting (#12064) 2022-10-21 11:08:45 +02:00
Sebastian Spaink d67f75e557
docs: Remove warning not to remove go:embed (#11797) 
Co-authored-by: Joshua Powers <powersj@fastmail.com>
 2022-09-13 12:47:58 -05:00
Joshua Powers 8c49ddccc3
chore: update to go1.19.1 (#11776) 2022-09-08 12:49:36 -06:00
Albertas Bužinskas b1546fe1c7
feat(inputs.kafka_consumer): Option to set default fetch message bytes (#11220) 2022-07-25 15:49:34 -06:00
Joshua Powers 2fc19fa308
chore: correctly spell embed (#11200) 2022-05-27 07:13:47 -06:00
Sven Rebhan 56eb914998
chore: Embed sample configurations into README for inputs (#11136) 2022-05-24 08:49:47 -05:00
Sebastian Spaink 8e2b4988fe
feat: migrate input plugins to new sample config format (A-L) (#10924) 2022-04-07 16:01:21 -06:00
Paweł Żak c875e45422
fix: Linter fixes for plugins/inputs/[a-o]* (leftovers) (#10192) 
Co-authored-by: Pawel Zak <Pawel Zak>
 2021-11-30 15:59:24 -06:00
Chris Ruscio 343e846480
feat: add max_processing_time config to Kafka Consumer input (#9988) 2021-10-28 14:35:22 -06:00
Paweł Żak eec6fd5702
fix: Linter fixes for plugins/inputs/[k-l]* (#9999) 2021-10-27 09:48:57 -06:00
Gerald Quintana 8265969f52
feat: Kafka Add metadata full to config (#9833) 2021-10-21 15:32:39 -06:00
Sven Rebhan 8e7da355b3
Linter fixes (unhandled errors) -- Part 1 (#8992) 2021-04-08 11:43:39 -05:00
Paweł Żak 74a1acd814
Linter fixes - revive:unused-parameter, unparam, varcheck and unused (#8984) 
* Linter fixes - revive:unused-parameter and unparam

* Linter fixes - revive:unused-parameter and unparam

* Linter fixes - revive:unused-parameter and unparam

* "nolint"'s removed

* Fixes for "varcheck" and "unused" added.

* Fixes for "varcheck" and "unused" added.

* Fixes for "varcheck" and "unused" added.

* Fixes for "varcheck" and "unused" added.

* Fixes for "varcheck" and "unused" added.

* Fixes for "varcheck" and "unused" added.

* Fixes for "varcheck" and "unused" added.

Co-authored-by: Pawel Zak <Pawel Zak>
 2021-03-22 12:21:36 -05:00
Steven Soroka 8b30bb9534
Enable kafka zstd compression and idempotent writes (#8435) 2020-11-23 15:51:58 -05:00
Steven Soroka e83a165635
kafka sasl-mechanism auth support for SCRAM-SHA-256, SCRAM-SHA-512, GSSAPI (#8318) 2020-10-28 12:16:59 -04:00
Daniel Nelson c73ed8ca6c
Export internal/tls package for use in execd plugins (#7697) 2020-06-25 11:44:22 -07:00
Daniel Nelson b6de4da41f
Add topic tag options to kafka output (#7142) 2020-03-10 13:38:26 -07:00
Daniel Nelson 2486006495
Add kafka SASL version control to kafka_consumer (#6350) 2020-01-02 16:27:26 -08:00
Enno Lohmeier e04bb1e07f Support partition assignement strategy configuration in kafka_consumer (#6688) 2019-11-27 10:54:29 -08:00
Daniel Nelson 76e7b57fcd
Fix could not mark message delivered error in kafka_consumer (#6363) 2019-09-06 12:35:33 -07:00
Daniel Nelson 9bdb3992d5
Require Kafka 0.10.2.0 or later in kafka_consumer (#6181) 2019-07-30 21:33:29 -07:00
Daniel Nelson aea09b3a20
Use sarama built in support for consumer groups (#6172) 2019-07-29 20:41:12 -07:00
Greg d0a6051fd7 Prevent panic when marking the offset in kafka_consumer (#5118) 2018-12-10 15:55:58 -08:00
Sebastien Le Digabel 448c98d82e Add ability to tag metrics with topic in kafka_consumer (#5038) 2018-11-28 16:29:26 -08:00
Daniel Nelson 6e5c2f8bb6
Remove outputs blocking inputs when output is slow (#4938) 2018-11-05 13:34:28 -08:00
Daniel Nelson 886d8cc840
Drop message batches in kafka output if too large (#4565) 2018-08-17 13:51:21 -07:00
Daniel Nelson 49a5dea536
Update client_id in kafka input and output readme 2018-07-13 14:00:25 -07:00
Rion c8f00030dd Add support for setting kafka client id (#4418) 2018-07-13 13:53:56 -07:00
Daniel Nelson de355b76d6
Simplify testing with TLS (#4095) 2018-05-04 16:33:23 -07:00
Seuf 2092443cd7 Add Kafka 0.9+ consumer support (#2487) 2017-06-07 18:22:28 -07:00
Nick Irvine 0193cbee51 Add max_message_len in kafka_consumer input (#2636) 2017-04-11 12:05:39 -07:00
Patrick Hemmer 1402c158b7 remove sleep from tests (#2555) 2017-03-24 12:03:36 -07:00
Emil Haugbergsmyr 81f95e7a29 Fixes change in Kafka consumer input plugin (#2222) 
* Fixes change to the error api in the kafka project.

* Updated test to reflect the change.

* Update kafka to match master branch.
 2017-01-11 16:24:09 +00:00
Cameron Sparr c7834209d2 Major Logging Overhaul 
in this commit:

- centralize logging output handler.
- set global Info/Debug/Error log levels based on config file or flags.
- remove per-plugin debug arg handling.
- add a I!, D!, or E! to every log message.
- add configuration option to specify where to send logs.

closes #1786
 2016-10-03 17:13:03 +01:00
Cameron Sparr 9b2e2cc41f kafka panic: Check that error is non-nil before 
fixes #1764
 2016-09-14 08:54:22 +01:00
Cameron Sparr 137843b2f6 Change default zookeeper chroot to empty string 
closes #1112
 2016-06-10 12:07:36 +01:00
Cameron Sparr e436b2d720 Cleanup & standardize config file 
changes:

- -sample-config will now comment out all but a few default plugins.
- config file parse errors will output path to bad conf file.
- cleanup 80-char line-length and some other style issues.
- default package conf file will now have all plugins, but commented
  out.

closes #199
closes #944
 2016-04-01 10:59:53 -06:00
Prune Sebastien THOMAS bd3d0c330f parsed with gofmt 
closes #776
 2016-03-07 18:48:02 +01:00
Prune Sebastien THOMAS 0060df9877 added zookeeper_chroot option 
added a plugin option zookeeper_chroot to set up the kafka endpoint in zookeeper, which may not be / (default).
This chroot is then configured in the consumergroup config.Zookeeper.Chroot

This is workaround the fact that this plugins does not handle the urls like    "zookeeper_server:port/chroot"
As the peers are stored in an array, it makes no sens to have them beeing URL. Peers should all be members of the same cluster, so they all have the same chroot.
 2016-03-07 18:46:10 +01:00
Cameron Sparr 8d2e5f0bda Seems to be a toml parse bug around triple pounds 2016-02-18 14:36:03 -07:00