Component(s)
extension/encoding/awslogsencoding
Describe the issue you're reporting
#46211 (comment)
We're introducing stream decoding to the awslogsencoding extension. The stream decoding API does not provide a clean way of transparent decompression: decompressors need to be closed when done with, and this isn't supported by the API.
We could change the stream decoding API, or we could use the EOF as a signal to close the decompressor, neither of which seems ideal.
The S3 receiver already does decompression itself. We should consider doing the same in other receivers that may be used with the awslogsencoding extension, i.e. Firehose, and Lambda. We can then deprecate and ultimately remove transparent decompression in the encoding extension.
Tip
React with 👍 to help prioritize this issue. Please use comments to provide useful context, avoiding +1 or me too, to help us triage it. Learn more here.
Component(s)
extension/encoding/awslogsencoding
Describe the issue you're reporting
#46211 (comment)
We're introducing stream decoding to the awslogsencoding extension. The stream decoding API does not provide a clean way of transparent decompression: decompressors need to be closed when done with, and this isn't supported by the API.
We could change the stream decoding API, or we could use the EOF as a signal to close the decompressor, neither of which seems ideal.
The S3 receiver already does decompression itself. We should consider doing the same in other receivers that may be used with the awslogsencoding extension, i.e. Firehose, and Lambda. We can then deprecate and ultimately remove transparent decompression in the encoding extension.
Tip
React with 👍 to help prioritize this issue. Please use comments to provide useful context, avoiding
+1orme too, to help us triage it. Learn more here.