-
clp
Compressed Log Processor (CLP) is a free log management tool capable of compressing text logs and searching the compressed logs without decompression. (by y-scope)
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
Original CLP Paper: https://www.usenix.org/system/files/osdi21-rodrigues.pdf
Github project for CLP: https://github.com/y-scope/clp
The interesting part about the article isn't that structured data is easier to compress and store, its that there's a relatively new way to efficiently transform unstructured logs to structured data. For those shipping unstructured logs to an observability backend this could be a way to save significant money