Show HN: Columnar store for fast, lightweight logging https://ift.tt/1UtuiRI
Show HN: Columnar store for fast, lightweight logging Founder here, Parseable is a lightweight log ingestion and query engine written in Rust. Parseable can ingest data from existing logging agents (FluentBit, LogStash, Vector, syslog-ng and more) using HTTP + JSON output. Ingested logs are stored as semi-indexed Parquet files (on disk or S3). You can query the data with builtin query engine using SQL or use a query engines of choice like Spark, Presto, Trino and so on. We also developed a Grafana data source plugin that lets you visualise log data via Grafana. Sample dashboard link in readme. As log data grew, our industry has responded with SaaS and fully managed offerings, but if you're looking for freedom, interoperability and full control over your data - there are no great options. With Parseable, we are looking to provide an strong, viable and FOSS alternative. https://ift.tt/GejiWJH January 18, 2023 at 10:06PM
No comments: