Commit Graph

279 Commits

Author SHA1 Message Date
Sven Rebhan c46f42f797
feat: Migrate json parser to new style (#11226) 2022-06-22 09:56:51 -06:00
Thomas Casteleyn 2424852aa7
fix(parsers/xpath): Reduce debug messages when empty selection is allowed (#11302) 2022-06-15 13:10:02 -06:00
Sven Rebhan 0d96968819
feat: Migrate xpath parser to new style (#11218) 2022-06-08 13:39:02 -06:00
Sven Rebhan 5da99fa62e
fix: bump github.com/tidwall/gjson from 1.10.2 to 1.14.1 (#11264)
* Bump github.com/tidwall/gjson from v1.10.2 to v1.14.1

* Fix node references which are switched to parent relative now.
2022-06-07 09:38:56 -05:00
reimda 34eff493ae
chore: Fix readme linter errors for processor, aggregator, and parser plugins (#10960) 2022-06-06 17:04:28 -06:00
Sven Rebhan 0b5dedbc02
fix: Upgrade xpath and fix code (#11241) 2022-06-01 14:42:48 -06:00
Sven Rebhan 56eb914998
chore: Embed sample configurations into README for inputs (#11136) 2022-05-24 08:49:47 -05:00
Thomas Casteleyn 9a6816782b
feat: do not error if no nodes found for current config with xpath parser (#11102) 2022-05-19 09:00:23 -06:00
Sakerdotes 42f954fc88
fix(parsers/nagios): metrics will always return a supported status co… (#11062)
Co-authored-by: Morten Urban <morten.urban@sectornord.de>
2022-05-17 15:14:26 -05:00
Thomas Casteleyn 442728b03e
feat(parsers/logfmt): Add tag support (#11060) 2022-05-17 15:08:03 -05:00
Eng Zer Jun 81090be35d
refactor: replace strings.Replace with strings.ReplaceAll (#11079) 2022-05-11 09:53:34 -06:00
Alexander Kapshuna 18980772a9
docs: correct influx parser type setting in README (#11004) 2022-04-20 07:14:03 -06:00
JackSharebourg d38665fbb6
docs: update csv parser metadata descriptions (#10750) 2022-04-12 07:53:34 -06:00
Sven Rebhan 6f0c5afe48
fix: fix handling of imports in protocol-buffer definitions (#10798) 2022-03-23 09:28:17 -06:00
Sebastian Spaink b526945c64
fix(parsers.json_v2): Check if gpath exists and support optional in fields/tags (#10799) 2022-03-11 12:51:37 -07:00
Joshua Powers 40ed7fb693
feat(parsers.influx): New influx line protocol via feature flag (#10749) 2022-03-10 15:09:58 -07:00
Reimer Prochnow 03d7c4693e
fix(json_v2): allow multiple optional objects (#10777) 2022-03-08 07:55:30 -07:00
Joshua Powers e4823a4c57
docs: add value_field_name to value processor (#10740) 2022-03-01 09:28:41 -07:00
JackSharebourg c2458fe6b8
fix: typo metadata support in csv parser (#10742) 2022-02-28 07:21:47 -07:00
Sven Rebhan 9387fb602d
feat: Add tag batch-processing to XPath parser (#10585) 2022-02-24 15:09:33 -07:00
Ehsan 5adecc3cd9
feat(parsers/csv): Add metadata support to CSV parser plugin (#10083) 2022-02-23 19:28:16 -06:00
Grimsby 6ae9320275
fix: timestamp change during execution of json_v2 parser. (#10657)
Co-authored-by: Kristian Grimsby <grimsby@Kristians-MacBook-Pro.local>
2022-02-15 10:48:15 -06:00
Mark Rushakoff 25e8b45284
fix: incorrect handling of json_v2 timestamp_path (#10618) 2022-02-15 09:08:53 -06:00
Sebastian Spaink 75946f56f1
fix(parsers.json_v2): allow optional paths and handle wrong paths correctly (#10468) 2022-02-03 15:08:09 -07:00
Mya b2cfbb1acb
fix: typo in docs (#10441) 2022-01-25 15:12:32 -08:00
Sakerdotes 83ab2b8bb5
fix(parsers.nagios): nagios parser now uses real error for logging #10472 (#10473) 2022-01-20 10:42:40 -07:00
Sven Rebhan 193dc450c3
feat: Parser plugin restructuring (#8791) 2022-01-12 15:54:42 -07:00
Sebastian Spaink 18704de6ed
fix(json_v2): use raw values for timestamps (#10413) 2022-01-11 10:08:59 -06:00
Howie 381dc22723
chore: typos across source code comments (#10361) 2022-01-05 08:20:10 -07:00
Joshua Powers 078242ba6b
fix: empty import tzdata for Windows binaries (#10377)
The telegraf binary currently does not include any timezone data. While
this data is usually readily available in linux systems it is not
available to a go binary in Windows.

Fixes: #8756
2022-01-05 08:18:12 -07:00
Alberto Fernandez a202f68333
feat: add option to skip errors during CSV parsing (#10267) 2021-12-22 13:07:14 -07:00
Sven Rebhan aa642a4046
fix: Handle duplicate registration of protocol-buffer files gracefully. (#10188) 2021-12-10 14:25:24 -07:00
Joshua Powers f9d719d636
fix: json_v2 parser timestamp setting (#10221) 2021-12-06 12:18:06 -07:00
Paweł Żak 8e85a67ee1
fix: Linter fixes for plugins/parsers/[a-z]* (#10145) 2021-11-24 11:52:51 -07:00
Joshua Powers 779c1f0a59
chore: clean up all markdown lint errors in parser plugins (#10153) 2021-11-24 11:45:25 -07:00
Ehsan db86904759
fix: directory monitor input plugin when data format is CSV and csv_skip_rows>0 and csv_header_row_count>=1 (#9865) 2021-11-16 15:05:48 -07:00
Sebastian Spaink 8f309dc34d
fix(parser/csv): resolve linter issues (#10093) 2021-11-10 17:45:50 -06:00
Dane Strandboge ddeb6ec890
build: move to new protobuf library (#10019) 2021-11-09 08:51:14 -06:00
Sebastian Spaink 061b4094cd
fix(json_v2): remove dead code (#9908) 2021-10-13 13:04:02 -05:00
Sebastian Spaink 0be92db8af
docs: json_v2 improved var naming and comments (#9907) 2021-10-12 15:07:34 -06:00
Sebastian Spaink 66da86017f
chore: json_v2 read testdata dir for tests (#9906) 2021-10-12 15:04:36 -06:00
Sebastian Spaink da5727e34c
fix: duplicate line_protocol when using object and fields (#9872) 2021-10-07 15:45:02 -05:00
Patrick Hemmer 128ed8849b
fix: memory leak in influx parser (#9787) 2021-10-07 15:35:44 -05:00
Yuji Kawamoto d2a25456d5
feat(prometheus): add ignore_timestamp option (#9740) 2021-10-05 15:11:46 -06:00
Sebastian Spaink df5c19c17e
feat (parser.json_v2): Support defining field/tag tables within an object table (#9449) 2021-10-04 13:19:06 -05:00
Eng Zer Jun 6a3b27126a
refactor: move from io/ioutil to io and os package (#9811) 2021-09-28 15:16:32 -06:00
Sven Rebhan c076398440
fix: Fix panic for non-existing metric names (#9757) 2021-09-15 11:58:40 -06:00
Sebastian Spaink 3a7d9b6d98
fix: support 1.17 & 1.16.7 Go versions (#9642) 2021-08-23 15:37:44 -05:00
Dominik Rosiek 348c18db75
feat(http_listener_v2): allows multiple paths and add path_tag (#9529) 2021-07-27 16:10:50 -05:00
Sebastian Spaink d6b7d4da2c
Simplify how nesting is handled (#9504) 2021-07-22 19:09:01 -05:00
Alexander Krantz 2eb0ee2e1e
Add support for large uint64 and int64 numbers (#9520) 2021-07-19 22:23:12 -05:00
Sebastian Spaink 1b20680e37
Fix json_v2 parser to handle nested objects in arrays properly (#9479) 2021-07-08 13:05:41 -05:00
Sven Rebhan 25413b2b6d
XPath parser extension to allow parsing of JSON, MessagePack and Protocol-buffers (#9277) 2021-07-01 16:48:16 -04:00
Mya 8638a41724
tags no longer required in included_keys (#9406) 2021-06-22 11:48:29 -05:00
Sebastian Spaink daec1040c6
Update json_v2 parser to handle null types (#9368) 2021-06-15 16:50:20 -06:00
Sebastian Spaink 885252d388
New JSON Parser (#9246) 2021-06-10 13:22:18 -06:00
Helen Weller 940fea9135
fix spelling of receive (#9269) 2021-05-13 15:28:14 -04:00
Julien Riou 4336dae3b5
Make JSON format compatible with nulls (#9110) 2021-04-20 17:47:14 -04:00
David Bennett 842a788022
Remove error return type from metric.New method (#9116)
* Remove error return type from metric.New method.

* Formatting changes for linter + gofmt

* Additional linter fixes.

* More linter fixes.

* Linter fix.

* address comments
2021-04-13 14:40:03 -04:00
Samantha Wang 411df7d763
update promremotewrite readme
make influxdb 1.x alignment a header
2021-04-13 08:04:10 -07:00
Helen Weller 885bf273a9
Starlark script for renaming prometheus remote write metrics (#9074) 2021-03-31 15:08:34 -04:00
Samantha Wang f26084acf1
add xpath testers to xml readme (#9049)
* add xpath testers to xml readme

* fix linking
2021-03-25 13:15:33 -07:00
Paweł Żak 099ccda3f9
Linter fixes - gosimple (#9046) 2021-03-25 13:57:01 -04:00
Patryk Małek e96955d1bb
Bump prometheus dependency to v2.21.0 (#8795)
* Bump prometheus dependency to v2.21.0

* Make golangci-lint happy
2021-03-25 11:18:50 -05:00
Paweł Żak 5de640b855
Linter fixes - unconvert, revive:empty-lines, revive:var-naming, revive:unused-parameter (#9036)
Co-authored-by: Pawel Zak <Pawel Zak>
2021-03-24 11:27:46 -04:00
Paweł Żak 74a1acd814
Linter fixes - revive:unused-parameter, unparam, varcheck and unused (#8984)
* Linter fixes - revive:unused-parameter and unparam

* Linter fixes - revive:unused-parameter and unparam

* Linter fixes - revive:unused-parameter and unparam

* "nolint"'s removed

* Fixes for "varcheck" and "unused" added.

* Fixes for "varcheck" and "unused" added.

* Fixes for "varcheck" and "unused" added.

* Fixes for "varcheck" and "unused" added.

* Fixes for "varcheck" and "unused" added.

* Fixes for "varcheck" and "unused" added.

* Fixes for "varcheck" and "unused" added.

Co-authored-by: Pawel Zak <Pawel Zak>
2021-03-22 12:21:36 -05:00
Helen Weller 67f588cbce
New prometheus remote write parser (#8967) 2021-03-18 11:33:58 -04:00
Sven Rebhan 808b7c1ba5
Improve xml parser's handling of missing values (#8971) 2021-03-16 16:15:18 -04:00
Paweł Żak 38c61c07ef
Revive fixes - part 4: (#8981)
empty-lines

Co-authored-by: Pawel Zak <Pawel Zak>
2021-03-12 14:21:51 -06:00
David Bennett c905116ade
Add 'field name' config option to customize field name when using Value parser. (#8979) 2021-03-11 21:53:32 -05:00
reimda 431d06acc0
Add XML parser using XPath queries (#8931) 2021-03-03 13:26:09 -07:00
Paweł Żak 17efd172b7
Clearing LGTM alerts and warnings (#8923) 2021-03-03 14:56:31 -05:00
Paweł Żak 8a6907a186
Revive fixes - part 3 (#8872)
* * Revive fixes regarding following set of rules: [rule.var-naming]
2021-03-01 16:04:35 -05:00
Paweł Żak d9736d543f
Revive fixes - part 2 (#8835)
* Revive fixes regarding following set of rules:
[rule.if-return]
[rule.increment-decrement]
[rule.var-declaration]
[rule.package-comments]
[rule.receiver-naming]
[rule.unexported-return]
2021-02-16 18:19:50 -05:00
Paweł Żak ba66d4facb
Revive fixes - part 1 (#8797)
* Revive fixes regarding following set of rules:
[rule.blank-imports]
[rule.context-as-argument]
[rule.context-keys-type]
[rule.dot-imports]
[rule.error-return]
[rule.error-strings]
[rule.indent-error-flow]
[rule.errorf]
2021-02-08 11:18:40 -05:00
Adrian Thurston 4462b172f3
fix: remove ambiguity on '\v' from line-protocol parser (#8720) 2021-01-20 18:33:59 -05:00
Helen Weller 3b87438dea
Added ability to define skip values in csv parser (#8627) 2021-01-11 13:53:06 -05:00
Aladex 4b7d11385c
Using mime-type in prometheus parser to handle protocol-buffer responses (#8545) 2021-01-07 11:21:09 -05:00
Helen Weller 9f31184e20
Fix readme link for line protocol in influx parser (#8610) 2020-12-21 14:37:50 -05:00
Helen Weller 94eb8f2e42
Add wildcard tags json parser support (#8579) 2020-12-17 19:32:25 -05:00
Steven Soroka 7ff96a7424 Revert "Update grok package to support for field names containing '-' and '.' (#8276)"
This reverts commit a5f3121f6d.

(cherry picked from commit 5c826e8a3254dc509012d018638a2e5f41a110f2)
2020-12-16 17:29:41 -05:00
Steven Soroka 717d329af8 Revert "disable flakey grok test for now"
This reverts commit a96c8b49e4.

(cherry picked from commit 115e25ea36b854d4e5f941596dfb965d103c1376)
2020-12-16 17:29:10 -05:00
Hítalo Silva f6e2d451cd
Graphite tags parser (#8564) 2020-12-15 13:41:51 -05:00
Samantha Wang d9d6a194b1
Update json parser readme (#8532) 2020-12-15 10:09:11 -07:00
Steven Soroka a96c8b49e4 disable flakey grok test for now 2020-12-10 13:20:37 -05:00
Dmitry Senin 0ccb134ae4
Add a parser plugin for prometheus (#7778) 2020-12-02 12:48:44 -07:00
Hong a5f3121f6d
Update grok package to support for field names containing '-' and '.' (#8276) 2020-12-02 13:11:35 -05:00
Stephanie Engel 247230c5c9
keep field name as is for csv timestamp column (#8440) 2020-11-20 09:52:07 -06:00
Sven Rebhan 049daf7892
Fix parsing of multiple files with different headers (#6318). (#8400) 2020-11-13 10:36:08 -05:00
Russ Savage dabea48a90
Fix minor typos in readmes (#8370) 2020-11-12 10:20:50 -07:00
Roger Peppe 9ee87ab7c3
fix: plugins/parsers/influx: avoid ParseError.Error panic (#8177) 2020-09-30 13:26:00 -04:00
Russ Savage 75e701c288
fix(readmes): adding code block annotations (#7963) 2020-08-10 15:50:48 -04:00
Stephen Solka 6580c6a597
prefer testify error funcs over nil checks (#7857) 2020-07-20 10:34:46 -04:00
Daniel Nelson be77fbab31
Support utf-16 in file and tail inputs (#7792) 2020-07-07 12:43:32 -07:00
Daniel Nelson 72e3ff04bd
Link to GJSON playground in json parser documentation (#7698) 2020-06-17 12:15:43 -07:00
Haidlir Naqvi adbc425961
Add timezone configuration to csv data format (#7619) 2020-06-08 14:52:46 -07:00
Steven Soroka 7ba226a00b
fix issue with stream parser blocking when data is in buffer (#7631) 2020-06-05 18:30:25 -04:00
Steven Soroka a438678d5b
make sure parse error includes offending text (#7561) 2020-05-27 14:58:58 -04:00
Harshit Bansal 092059c066
Exclude csv_timestamp_column and csv_measurement_column from fields (#7572) 2020-05-26 14:16:48 -07:00
Josh Soref bf1eb291f2
Fix assorted spelling mistakes (#7507) 2020-05-15 15:43:32 -07:00