Commit Graph

82 Commits

Author SHA1 Message Date
Thomas Casteleyn 61523bd4b9
feat(tools/readme_linter): Check for global configuration section (#12426) 2023-01-12 16:55:21 +01:00
Sven Rebhan 6fb08bb3da
feat(kafka): Add keep-alive period setting for input and output. (#12459) 2023-01-05 16:48:31 +01:00
Trevor North 70b33c2649
feat(inputs.kafka_consumer): Add sarama debug logs (#12304) 2022-12-05 21:54:08 +01:00
Paweł Żak 6816aefcd5
chore: fix linter findings for unparam and revive.unused-parameter (#12150) 2022-11-08 12:04:12 -07:00
reimda 494f558b4e
feat: Add exponential backoff when connecting or reconnecting and allow plugin to start without making initial connection (#12111) 2022-11-03 08:01:22 -05:00
Paweł Żak e2b999267f
chore: Fix linter findings introduced in last PRs (#12131) 2022-11-01 11:27:37 +01:00
Joshua Powers 49ac03fa80
docs: add global configuration header (#12107) 2022-10-26 14:58:36 -05:00
reimda 3196bc4c1c
chore: shut down plugins gracefully to prevent race (#12102) 2022-10-26 09:32:58 -06:00
reimda d88067566c
chore: skip integration test with race (#12100) 2022-10-25 09:41:46 -06:00
reimda 7d9f09ddc8
chore: add kafka round trip integration test using inputs.kafka_consumer and outputs.kafka (#12058) 2022-10-25 07:50:59 -06:00
reimda a6352d9794
fix(inputs.kafka): switch to sarama's new consumer group rebalance strategy setting (#12064) 2022-10-21 11:08:45 +02:00
Paweł Żak dbf6796a89
fix: Setting `enable_tls` has incorrect default value (#11941)
Co-authored-by: Pawel Zak <Pawel Zak>
2022-10-05 10:07:28 +02:00
Joshua Blanchard 2b03cd9151
fix(common.kafka): Enable TLS in Kafka plugins without custom config (#11519) 2022-09-26 12:14:14 -06:00
Sebastian Spaink d67f75e557
docs: Remove warning not to remove go:embed (#11797)
Co-authored-by: Joshua Powers <powersj@fastmail.com>
2022-09-13 12:47:58 -05:00
Joshua Powers 8c49ddccc3
chore: update to go1.19.1 (#11776) 2022-09-08 12:49:36 -06:00
Sven Rebhan e2578462a5
fix(inputs): Linter issues (#11576) 2022-08-02 13:52:17 +02:00
reimda ca8a6cfac2
chore: add missing section to kafka_consumer's sample.conf (#11553) 2022-07-26 12:53:06 -06:00
Albertas Bužinskas b1546fe1c7
feat(inputs.kafka_consumer): Option to set default fetch message bytes (#11220) 2022-07-25 15:49:34 -06:00
Joshua Powers b423a3ec40
feat: migrate value parser to new style (#11407) 2022-06-29 14:46:43 -06:00
reimda 453e276718
chore: Fix readme linter errors for input plugins E-L (#11214) 2022-06-07 15:37:08 -06:00
Joshua Powers 2fc19fa308
chore: correctly spell embed (#11200) 2022-05-27 07:13:47 -06:00
Sven Rebhan 56eb914998
chore: Embed sample configurations into README for inputs (#11136) 2022-05-24 08:49:47 -05:00
Sebastian Spaink 6b697db11e
chore(inputs_a-l): migrate sample configs into separate files (#11132) 2022-05-18 11:31:52 -05:00
Sebastian Spaink 8e2b4988fe
feat: migrate input plugins to new sample config format (A-L) (#10924) 2022-04-07 16:01:21 -06:00
Paweł Żak c875e45422
fix: Linter fixes for plugins/inputs/[a-o]* (leftovers) (#10192)
Co-authored-by: Pawel Zak <Pawel Zak>
2021-11-30 15:59:24 -06:00
Mya 84562877cc
chore: clean up all markdown lint errors for input plugins i through m (#10173) 2021-11-24 12:18:53 -07:00
Chris Ruscio 343e846480
feat: add max_processing_time config to Kafka Consumer input (#9988) 2021-10-28 14:35:22 -06:00
Paweł Żak eec6fd5702
fix: Linter fixes for plugins/inputs/[k-l]* (#9999) 2021-10-27 09:48:57 -06:00
Gerald Quintana 8265969f52
feat: Kafka Add metadata full to config (#9833) 2021-10-21 15:32:39 -06:00
Sven Rebhan 8e7da355b3
Linter fixes (unhandled errors) -- Part 1 (#8992) 2021-04-08 11:43:39 -05:00
Paweł Żak 74a1acd814
Linter fixes - revive:unused-parameter, unparam, varcheck and unused (#8984)
* Linter fixes - revive:unused-parameter and unparam

* Linter fixes - revive:unused-parameter and unparam

* Linter fixes - revive:unused-parameter and unparam

* "nolint"'s removed

* Fixes for "varcheck" and "unused" added.

* Fixes for "varcheck" and "unused" added.

* Fixes for "varcheck" and "unused" added.

* Fixes for "varcheck" and "unused" added.

* Fixes for "varcheck" and "unused" added.

* Fixes for "varcheck" and "unused" added.

* Fixes for "varcheck" and "unused" added.

Co-authored-by: Pawel Zak <Pawel Zak>
2021-03-22 12:21:36 -05:00
David Bennett c905116ade
Add 'field name' config option to customize field name when using Value parser. (#8979) 2021-03-11 21:53:32 -05:00
Steven Soroka 8b30bb9534
Enable kafka zstd compression and idempotent writes (#8435) 2020-11-23 15:51:58 -05:00
Steven Soroka e83a165635
kafka sasl-mechanism auth support for SCRAM-SHA-256, SCRAM-SHA-512, GSSAPI (#8318) 2020-10-28 12:16:59 -04:00
reimda 5a5f6fbd47
Update sarama library to 1.27.1 (#8289) 2020-10-20 11:42:37 -04:00
Daniel Nelson c73ed8ca6c
Export internal/tls package for use in execd plugins (#7697) 2020-06-25 11:44:22 -07:00
Daniel Nelson c06eef47e7
Fix data race in kafka_consumer_test.go (#7737) 2020-06-24 15:21:56 -07:00
Daniel Nelson b6de4da41f
Add topic tag options to kafka output (#7142) 2020-03-10 13:38:26 -07:00
Daniel Nelson 2486006495
Add kafka SASL version control to kafka_consumer (#6350) 2020-01-02 16:27:26 -08:00
Enno Lohmeier e04bb1e07f Support partition assignement strategy configuration in kafka_consumer (#6688) 2019-11-27 10:54:29 -08:00
Daniel Nelson 76e7b57fcd
Fix could not mark message delivered error in kafka_consumer (#6363) 2019-09-06 12:35:33 -07:00
Daniel Nelson 9bdb3992d5
Require Kafka 0.10.2.0 or later in kafka_consumer (#6181) 2019-07-30 21:33:29 -07:00
Daniel Nelson aea09b3a20
Use sarama built in support for consumer groups (#6172) 2019-07-29 20:41:12 -07:00
Greg d0a6051fd7 Prevent panic when marking the offset in kafka_consumer (#5118) 2018-12-10 15:55:58 -08:00
Sebastien Le Digabel 448c98d82e Add ability to tag metrics with topic in kafka_consumer (#5038) 2018-11-28 16:29:26 -08:00
Daniel Nelson 6e5c2f8bb6
Remove outputs blocking inputs when output is slow (#4938) 2018-11-05 13:34:28 -08:00
Daniel Nelson 2b026374ec
Update kafka_consumer sample config in README 2018-08-23 11:46:41 -07:00
maxunt 2729378b7f Add name, time, path and string field options to JSON parser (#4351) 2018-08-22 19:26:48 -07:00
Daniel Nelson 886d8cc840
Drop message batches in kafka output if too large (#4565) 2018-08-17 13:51:21 -07:00
Daniel Nelson 49a5dea536
Update client_id in kafka input and output readme 2018-07-13 14:00:25 -07:00