Commit Graph

405 Commits

Author SHA1 Message Date
Joshua Powers 013b73213d
chore: Spell endianness correctly (#13752) 2023-08-14 10:43:32 +02:00
Sven Rebhan 806b7cd67f
fix(parsers.xpath): Handle protobuf maps correctly (#13719) 2023-08-07 15:50:49 -06:00
Lucas Chiesa 3f8e916455
feat(parsers.xpath): Add option to store fields as base64 (#13690) 2023-07-28 08:09:23 -06:00
Sven Rebhan f804d6395e
chore(deps): Bump github.com/antchfx/xpath from v1.2.4 to latest master (#13679) 2023-07-26 11:02:03 -06:00
Sven Rebhan da28cfdb43
fix(parsers.xpath): Ensure precedence of explicitly defined tags and fields (#13662) 2023-07-26 09:44:22 -06:00
Sven Rebhan 64f6c97d13
fix(parsers.xpath): Improve handling of complex-type nodes (#13660) 2023-07-26 07:11:25 -06:00
Sven Rebhan 10f735c2cc
fix(parsers.xpath): Fix field-names for arrays of simple types (#13665) 2023-07-25 07:35:32 -06:00
Sven Rebhan 714f3c187f
feat(parsers.avro): Add support for JSON format (#13607) 2023-07-14 16:05:03 +02:00
Joshua Powers 14f52eae01
feat(parsers.influx): Allow a user to set the timestamp precision (#13419) 2023-07-13 11:09:12 -06:00
Sven Rebhan 57bcdaf695
fix(parsers.xpath): Handle explicitly defined fields correctly (#13550) 2023-07-06 16:16:35 +02:00
trsnx 10c081dab1
fix(parsers.binary): Fix binary parser example in README.md (#13547) 2023-07-05 08:11:32 -06:00
Joshua Powers 657eca5cf0
fix(parsers.grok): Use UTC as the default timezone (#13526) 2023-06-30 19:20:48 +02:00
Sven Rebhan e2fb181a80
feat(parsers.value): Add support for automatic fallback for numeric types (#13506) 2023-06-29 12:13:34 +02:00
Sven Rebhan c35cabda9e
feat(parsers.xpath): Add Concise Binary Object Representation parser (#13480) 2023-06-28 15:26:50 -06:00
Sven Rebhan 97d10a5ee9
fix(internal): Fix time parsing for abbreviated timezones (#13363) 2023-06-02 10:05:55 -06:00
Sven Rebhan 7ced2606b2
chore(parsers)!: Remove old-style creation (#13310) 2023-05-23 14:17:11 -06:00
cui fliter b08a2bb324
chore(docs): Remove repetitive "the" (#13295) 2023-05-22 06:14:01 -06:00
Nick Thomas a808b9f077
feat(parsers.opentsdb): Add OpenTSDB data format parser (#13167) 2023-05-05 07:14:51 -06:00
Joshua Powers 35d1ee3d96
docs: use single quotes for multi-line literal TOML (#13124)
fixes: #13123
2023-04-21 07:24:55 -06:00
Sven Rebhan 302ac88bdb
fix(parsers.grok): Fix nil metric for multiline inputs (#13078) 2023-04-12 16:15:35 -06:00
Paweł Żak 5f2142a6cc
chore: Enable G601 rule for gosec (#13042) 2023-04-12 16:56:07 +02:00
Paweł Żak 55e4bb6808
chore: Enable G103 rule for gosec (#13038) 2023-04-12 07:32:46 -06:00
r3inbowari 19c4316694
chore: Update README.md (#12989) 2023-04-04 13:43:49 +02:00
Paweł Żak c76f319b84
chore: Remove `revive:unhandled-error` - `errcheck` is more flexible (#13008) 2023-04-03 07:19:43 -06:00
Sven Rebhan bea5414384
feat(parsers.xpath): Add timezone handling (#12820) 2023-03-13 12:17:14 +01:00
Adam Thornton acd1500d2b
feat(parsers.avro): Add Apache Avro parser (#11816) 2023-03-02 11:10:47 -07:00
Thomas Casteleyn 6a2f6f301f
chore: eliminate unnecessary use of quoted strings in printf (#12722) 2023-02-23 06:49:36 -07:00
Sven Rebhan 245705cf24
fix(parsers.xpath): Fix panic for JSON name expansion (#12724) 2023-02-22 16:30:31 -07:00
Paweł Żak 4201f24020
chore: Fix linter findings for errorlint (part2) (#12702)
Co-authored-by: Pawel Zak <Pawel Zak>
2023-02-22 12:08:46 +01:00
Frank Inselbuch 0cedfa6398
docs(parsers.json_v2): fix spelling typo (#12711) 2023-02-21 07:16:11 -07:00
Joshua Powers fa26b6498b
docs: remove trailing whitespace (#12660) 2023-02-09 12:35:18 -07:00
Paweł Żak e84bc0c590
chore: clean up import shadowing issues (#12588) 2023-02-01 11:21:38 -07:00
Martin Haaß 82ec689630
fix(json_v2): In case of invalid json, log messsage to debug log (#12440) 2023-01-12 16:16:06 +01:00
Joshua Powers 42640b1def
test(parsers.json): add fuzz test (#12368) 2022-12-13 06:41:08 -07:00
Meceron e264721cb9
feat(parsers.csv): suport null delimiters (#12247) 2022-12-12 09:55:47 -07:00
Sven Rebhan db7cb4ec25
chore: Move host-endianness definition to `internal` (#12360) 2022-12-08 22:04:57 +01:00
Sven Rebhan 6b08068d6d
feat(parsers.grok): add option to allow multiline messages (#12320) 2022-12-07 13:05:02 -07:00
Thomas Casteleyn 712092bd92
feat(parsers.csv): add option for overwrite tags (#12008) 2022-11-30 08:08:19 -07:00
Paweł Żak 960a1f7b14
chore: Fix linter findings for prealloc (part3) (#12246) 2022-11-21 21:53:55 +01:00
Paweł Żak 743e023f84
chore: Fix linter findings for makezero (part1) (#12254) 2022-11-21 21:07:07 +01:00
Sven Rebhan e311435753
feat(parsers.xpath): Allow to specify byte-array fields to encode in HEX (#11999) 2022-11-21 20:56:02 +01:00
Sven Rebhan d2268f04d0
feat(parsers.binary): handle hex-encoded inputs (#12232) 2022-11-16 13:43:13 -07:00
Paweł Żak 0c5d8de5e2
chore: enable lll linter (#12226) 2022-11-11 08:17:15 -07:00
Paweł Żak 6816aefcd5
chore: fix linter findings for unparam and revive.unused-parameter (#12150) 2022-11-08 12:04:12 -07:00
Paweł Żak 7807847356
chore: Wrap long lines in plugins/parsers (#12180) 2022-11-08 18:47:35 +01:00
Thomas Casteleyn 453f36e8ef
chore(parsers.xpath): Add correct deprecation tags (#11986) 2022-10-31 07:42:50 -06:00
Sven Rebhan 393566d9ba
feat(parsers): Add binary parser (#11552) 2022-10-31 14:15:23 +01:00
Joshua Powers 7c1d1755d8
fix(parsers.json_v2): Remove BOM before parsing (#11926) 2022-10-12 13:08:56 -06:00
Sven Rebhan 8ca3b9262a
feat(parsers.xpath): Add option to skip (header) bytes (#11933) 2022-10-11 09:27:07 -06:00
Sven Rebhan 758f2cba7a
fix(parser.xpath): Handle floating-point times correctly (#11875) 2022-10-03 08:32:52 -06:00
Joshua Powers 173d32a201
fix(inputs.influxdb_listener): error on invalid precision (#11866) 2022-10-03 07:23:06 -06:00
Sven Rebhan 4897f86ed7
fix(parsers.csv): Remove direct checks for the parser type (#11825) 2022-09-19 12:15:32 -06:00
Sven Rebhan 2b7cafcdbe
fix(parsers): Unwrap parser and remove some special handling (#11826) 2022-09-19 09:57:24 -06:00
Sven Rebhan 97b4db8438
fix(parsers.xpath): Add array index when expanding names. (#11781) 2022-09-15 15:42:18 -06:00
Joshua Powers 8c49ddccc3
chore: update to go1.19.1 (#11776) 2022-09-08 12:49:36 -06:00
reimda 07179c466b
chore: Use build tags to select plugins (#11654) 2022-08-15 22:44:59 +02:00
Sven Rebhan 401d2b2a28
chore(parsers.json_v2): Cleanup test by reusing testutil function (#11627) 2022-08-08 11:53:47 -05:00
Sven Rebhan 091380f4b5
fix(parsers): Linter issues (#11607) 2022-08-05 18:16:10 +02:00
Sven Rebhan 3ad9fe73ba
chore: More parser cleanup (#11532) 2022-07-28 15:30:36 -05:00
Sven Rebhan ff17ede62d
feat(parsers.xpath): Add support for returning underlying data-types (#11558) 2022-07-28 07:18:55 -05:00
Martin Molnar 2ac311c4f9
fix(parsers.prometheus): histogram infinity bucket must be allways present (#11490) (#11486) 2022-07-15 07:11:02 -06:00
reimda 4d2ebe587d
fix: Update prometheusremotewrite parser to be a new style parser plugin (#11456) 2022-07-07 20:11:38 -06:00
Sebastian Spaink 9744c3a6a2
feat: Migrate influx and influx_upstream parsers to new style (#11432) 2022-07-06 15:23:13 -05:00
reimda c25f9a0e83
fix: Update prometheus parser to be a new style parser plugin (#11440) 2022-07-06 10:07:53 -06:00
Sebastian Spaink 9e50853ab8
feat: Migrate nagios parser to new style (#11402) 2022-06-30 13:20:32 -05:00
Sven Rebhan 7d83b076c2
fix: add reset-mode flag for CSV parser (#11288) 2022-06-30 12:11:25 -06:00
Joshua Powers 56a3f18cdf
feat: migrate grok to new parser style (#11408) 2022-06-30 08:10:27 -06:00
Sven Rebhan f8766bc1b1
feat: Migrate dropwizard parser to new style (#11371) 2022-06-29 17:11:27 -05:00
Sven Rebhan 9ea9314e27
feat: Migrate logfmt parser to new style (#11366) 2022-06-29 23:31:22 +02:00
Sven Rebhan e5bcc274ca
fix: Bring back old xpath section names (#11335) 2022-06-29 23:30:58 +02:00
Sven Rebhan e710192dc9
feat: Migrate graphite parser to new style (#11405) 2022-06-29 23:08:05 +02:00
Joshua Powers b423a3ec40
feat: migrate value parser to new style (#11407) 2022-06-29 14:46:43 -06:00
Sebastian Spaink b638c5353f
feat: migrate form_urlencoded parser to new style (#11381) 2022-06-29 13:08:12 -06:00
Sebastian Spaink bf4e0500f7
feat: Migrate collectd parser to new style (#11367) 2022-06-27 13:05:19 -06:00
Sebastian Spaink 6b009f3072
feat: migrate wavefront parser to new style (#11374) 2022-06-27 13:02:50 -06:00
Sven Rebhan 3f114e0921
feat: Migrate json_v2 parser to new style (#11343) 2022-06-22 13:50:43 -06:00
Sven Rebhan c46f42f797
feat: Migrate json parser to new style (#11226) 2022-06-22 09:56:51 -06:00
Thomas Casteleyn 2424852aa7
fix(parsers/xpath): Reduce debug messages when empty selection is allowed (#11302) 2022-06-15 13:10:02 -06:00
Sven Rebhan 0d96968819
feat: Migrate xpath parser to new style (#11218) 2022-06-08 13:39:02 -06:00
Sven Rebhan 5da99fa62e
fix: bump github.com/tidwall/gjson from 1.10.2 to 1.14.1 (#11264)
* Bump github.com/tidwall/gjson from v1.10.2 to v1.14.1

* Fix node references which are switched to parent relative now.
2022-06-07 09:38:56 -05:00
reimda 34eff493ae
chore: Fix readme linter errors for processor, aggregator, and parser plugins (#10960) 2022-06-06 17:04:28 -06:00
Sven Rebhan 0b5dedbc02
fix: Upgrade xpath and fix code (#11241) 2022-06-01 14:42:48 -06:00
Sven Rebhan 56eb914998
chore: Embed sample configurations into README for inputs (#11136) 2022-05-24 08:49:47 -05:00
Thomas Casteleyn 9a6816782b
feat: do not error if no nodes found for current config with xpath parser (#11102) 2022-05-19 09:00:23 -06:00
Sakerdotes 42f954fc88
fix(parsers/nagios): metrics will always return a supported status co… (#11062)
Co-authored-by: Morten Urban <morten.urban@sectornord.de>
2022-05-17 15:14:26 -05:00
Thomas Casteleyn 442728b03e
feat(parsers/logfmt): Add tag support (#11060) 2022-05-17 15:08:03 -05:00
Eng Zer Jun 81090be35d
refactor: replace strings.Replace with strings.ReplaceAll (#11079) 2022-05-11 09:53:34 -06:00
Alexander Kapshuna 18980772a9
docs: correct influx parser type setting in README (#11004) 2022-04-20 07:14:03 -06:00
JackSharebourg d38665fbb6
docs: update csv parser metadata descriptions (#10750) 2022-04-12 07:53:34 -06:00
Sven Rebhan 6f0c5afe48
fix: fix handling of imports in protocol-buffer definitions (#10798) 2022-03-23 09:28:17 -06:00
Sebastian Spaink b526945c64
fix(parsers.json_v2): Check if gpath exists and support optional in fields/tags (#10799) 2022-03-11 12:51:37 -07:00
Joshua Powers 40ed7fb693
feat(parsers.influx): New influx line protocol via feature flag (#10749) 2022-03-10 15:09:58 -07:00
Reimer Prochnow 03d7c4693e
fix(json_v2): allow multiple optional objects (#10777) 2022-03-08 07:55:30 -07:00
Joshua Powers e4823a4c57
docs: add value_field_name to value processor (#10740) 2022-03-01 09:28:41 -07:00
JackSharebourg c2458fe6b8
fix: typo metadata support in csv parser (#10742) 2022-02-28 07:21:47 -07:00
Sven Rebhan 9387fb602d
feat: Add tag batch-processing to XPath parser (#10585) 2022-02-24 15:09:33 -07:00
Ehsan 5adecc3cd9
feat(parsers/csv): Add metadata support to CSV parser plugin (#10083) 2022-02-23 19:28:16 -06:00
Grimsby 6ae9320275
fix: timestamp change during execution of json_v2 parser. (#10657)
Co-authored-by: Kristian Grimsby <grimsby@Kristians-MacBook-Pro.local>
2022-02-15 10:48:15 -06:00
Mark Rushakoff 25e8b45284
fix: incorrect handling of json_v2 timestamp_path (#10618) 2022-02-15 09:08:53 -06:00
Sebastian Spaink 75946f56f1
fix(parsers.json_v2): allow optional paths and handle wrong paths correctly (#10468) 2022-02-03 15:08:09 -07:00
Mya b2cfbb1acb
fix: typo in docs (#10441) 2022-01-25 15:12:32 -08:00
Sakerdotes 83ab2b8bb5
fix(parsers.nagios): nagios parser now uses real error for logging #10472 (#10473) 2022-01-20 10:42:40 -07:00
Sven Rebhan 193dc450c3
feat: Parser plugin restructuring (#8791) 2022-01-12 15:54:42 -07:00
Sebastian Spaink 18704de6ed
fix(json_v2): use raw values for timestamps (#10413) 2022-01-11 10:08:59 -06:00
Howie 381dc22723
chore: typos across source code comments (#10361) 2022-01-05 08:20:10 -07:00
Joshua Powers 078242ba6b
fix: empty import tzdata for Windows binaries (#10377)
The telegraf binary currently does not include any timezone data. While
this data is usually readily available in linux systems it is not
available to a go binary in Windows.

Fixes: #8756
2022-01-05 08:18:12 -07:00
Alberto Fernandez a202f68333
feat: add option to skip errors during CSV parsing (#10267) 2021-12-22 13:07:14 -07:00
Sven Rebhan aa642a4046
fix: Handle duplicate registration of protocol-buffer files gracefully. (#10188) 2021-12-10 14:25:24 -07:00
Joshua Powers f9d719d636
fix: json_v2 parser timestamp setting (#10221) 2021-12-06 12:18:06 -07:00
Paweł Żak 8e85a67ee1
fix: Linter fixes for plugins/parsers/[a-z]* (#10145) 2021-11-24 11:52:51 -07:00
Joshua Powers 779c1f0a59
chore: clean up all markdown lint errors in parser plugins (#10153) 2021-11-24 11:45:25 -07:00
Ehsan db86904759
fix: directory monitor input plugin when data format is CSV and csv_skip_rows>0 and csv_header_row_count>=1 (#9865) 2021-11-16 15:05:48 -07:00
Sebastian Spaink 8f309dc34d
fix(parser/csv): resolve linter issues (#10093) 2021-11-10 17:45:50 -06:00
Dane Strandboge ddeb6ec890
build: move to new protobuf library (#10019) 2021-11-09 08:51:14 -06:00
Sebastian Spaink 061b4094cd
fix(json_v2): remove dead code (#9908) 2021-10-13 13:04:02 -05:00
Sebastian Spaink 0be92db8af
docs: json_v2 improved var naming and comments (#9907) 2021-10-12 15:07:34 -06:00
Sebastian Spaink 66da86017f
chore: json_v2 read testdata dir for tests (#9906) 2021-10-12 15:04:36 -06:00
Sebastian Spaink da5727e34c
fix: duplicate line_protocol when using object and fields (#9872) 2021-10-07 15:45:02 -05:00
Patrick Hemmer 128ed8849b
fix: memory leak in influx parser (#9787) 2021-10-07 15:35:44 -05:00
Yuji Kawamoto d2a25456d5
feat(prometheus): add ignore_timestamp option (#9740) 2021-10-05 15:11:46 -06:00
Sebastian Spaink df5c19c17e
feat (parser.json_v2): Support defining field/tag tables within an object table (#9449) 2021-10-04 13:19:06 -05:00
Eng Zer Jun 6a3b27126a
refactor: move from io/ioutil to io and os package (#9811) 2021-09-28 15:16:32 -06:00
Sven Rebhan c076398440
fix: Fix panic for non-existing metric names (#9757) 2021-09-15 11:58:40 -06:00
Sebastian Spaink 3a7d9b6d98
fix: support 1.17 & 1.16.7 Go versions (#9642) 2021-08-23 15:37:44 -05:00
Dominik Rosiek 348c18db75
feat(http_listener_v2): allows multiple paths and add path_tag (#9529) 2021-07-27 16:10:50 -05:00
Sebastian Spaink d6b7d4da2c
Simplify how nesting is handled (#9504) 2021-07-22 19:09:01 -05:00
Alexander Krantz 2eb0ee2e1e
Add support for large uint64 and int64 numbers (#9520) 2021-07-19 22:23:12 -05:00
Sebastian Spaink 1b20680e37
Fix json_v2 parser to handle nested objects in arrays properly (#9479) 2021-07-08 13:05:41 -05:00
Sven Rebhan 25413b2b6d
XPath parser extension to allow parsing of JSON, MessagePack and Protocol-buffers (#9277) 2021-07-01 16:48:16 -04:00
Mya 8638a41724
tags no longer required in included_keys (#9406) 2021-06-22 11:48:29 -05:00
Sebastian Spaink daec1040c6
Update json_v2 parser to handle null types (#9368) 2021-06-15 16:50:20 -06:00
Sebastian Spaink 885252d388
New JSON Parser (#9246) 2021-06-10 13:22:18 -06:00
Helen Weller 940fea9135
fix spelling of receive (#9269) 2021-05-13 15:28:14 -04:00
Julien Riou 4336dae3b5
Make JSON format compatible with nulls (#9110) 2021-04-20 17:47:14 -04:00
David Bennett 842a788022
Remove error return type from metric.New method (#9116)
* Remove error return type from metric.New method.

* Formatting changes for linter + gofmt

* Additional linter fixes.

* More linter fixes.

* Linter fix.

* address comments
2021-04-13 14:40:03 -04:00
Samantha Wang 411df7d763
update promremotewrite readme
make influxdb 1.x alignment a header
2021-04-13 08:04:10 -07:00
Helen Weller 885bf273a9
Starlark script for renaming prometheus remote write metrics (#9074) 2021-03-31 15:08:34 -04:00
Samantha Wang f26084acf1
add xpath testers to xml readme (#9049)
* add xpath testers to xml readme

* fix linking
2021-03-25 13:15:33 -07:00
Paweł Żak 099ccda3f9
Linter fixes - gosimple (#9046) 2021-03-25 13:57:01 -04:00
Patryk Małek e96955d1bb
Bump prometheus dependency to v2.21.0 (#8795)
* Bump prometheus dependency to v2.21.0

* Make golangci-lint happy
2021-03-25 11:18:50 -05:00
Paweł Żak 5de640b855
Linter fixes - unconvert, revive:empty-lines, revive:var-naming, revive:unused-parameter (#9036)
Co-authored-by: Pawel Zak <Pawel Zak>
2021-03-24 11:27:46 -04:00
Paweł Żak 74a1acd814
Linter fixes - revive:unused-parameter, unparam, varcheck and unused (#8984)
* Linter fixes - revive:unused-parameter and unparam

* Linter fixes - revive:unused-parameter and unparam

* Linter fixes - revive:unused-parameter and unparam

* "nolint"'s removed

* Fixes for "varcheck" and "unused" added.

* Fixes for "varcheck" and "unused" added.

* Fixes for "varcheck" and "unused" added.

* Fixes for "varcheck" and "unused" added.

* Fixes for "varcheck" and "unused" added.

* Fixes for "varcheck" and "unused" added.

* Fixes for "varcheck" and "unused" added.

Co-authored-by: Pawel Zak <Pawel Zak>
2021-03-22 12:21:36 -05:00
Helen Weller 67f588cbce
New prometheus remote write parser (#8967) 2021-03-18 11:33:58 -04:00
Sven Rebhan 808b7c1ba5
Improve xml parser's handling of missing values (#8971) 2021-03-16 16:15:18 -04:00
Paweł Żak 38c61c07ef
Revive fixes - part 4: (#8981)
empty-lines

Co-authored-by: Pawel Zak <Pawel Zak>
2021-03-12 14:21:51 -06:00
David Bennett c905116ade
Add 'field name' config option to customize field name when using Value parser. (#8979) 2021-03-11 21:53:32 -05:00
reimda 431d06acc0
Add XML parser using XPath queries (#8931) 2021-03-03 13:26:09 -07:00
Paweł Żak 17efd172b7
Clearing LGTM alerts and warnings (#8923) 2021-03-03 14:56:31 -05:00
Paweł Żak 8a6907a186
Revive fixes - part 3 (#8872)
* * Revive fixes regarding following set of rules: [rule.var-naming]
2021-03-01 16:04:35 -05:00
Paweł Żak d9736d543f
Revive fixes - part 2 (#8835)
* Revive fixes regarding following set of rules:
[rule.if-return]
[rule.increment-decrement]
[rule.var-declaration]
[rule.package-comments]
[rule.receiver-naming]
[rule.unexported-return]
2021-02-16 18:19:50 -05:00