An open-source MPP query engine for sub-second analytics on data lakehouses and in its own storage, speaking the MySQL protocol.
12.2K+2 this week2.7KJavaApache-2.0Well maintainedUpdated 9 hours ago
#data-lake
Best open-source data lake query engines and tools (2026)
This kind of software queries, reads, writes and organizes large volumes of data stored in object storage or files. When picking one, check which table formats it supports, whether it fits the query tools or languages you already use, and how actively it is maintained. Trino is a distributed SQL query engine for fast analytical queries across many big data sources, and it is a option to consider as a replacement for Amazon Athena. delta-rs is a native Rust library for reading and writing Delta Lake tables, with Python bindings for use with pandas and other data tools. Homer is a packet capture server that ingests HEP packets into a DuckDB and Parquet data lake for search and call-flow analysis in SIP and VoIP work.
Sort:Recently added
7 repositories
A high-performance open table format for huge analytic datasets that lets engines like Spark, Trino, Flink and Hive safely share the same tables.
9.4K+8 this week3.7KJavaApache-2.0Updated yesterday
Open-source SIP/VoIP and RTC packet capture server that ingests HEP packets into a DuckDB/Parquet data lake for search and call-flow analysis.
2K+5 this week295GoOtherWell maintainedUpdated 4 hours ago
Code samples, tutorials and utilities for building ETL jobs and data integration pipelines on AWS Glue.
1.5K835PythonMIT-0Updated yesterday
A native Rust library for reading and writing Delta Lake tables, with Python bindings for use with pandas and other data tools.
3.4K+2 this week701RustApache-2.0Updated 6 hours ago
A Rust data and AI engine that serves federated SQL, search and LLM inference over your databases and APIs, with local acceleration and CDC replicas.
3.1K+9 this week237RustApache-2.0Updated 3 hours ago
Trino is a distributed SQL query engine for running fast analytical queries across big data sources.
13.5K+93 this week3.9KJavaApache-2.0Well maintainedUpdated 11 hours ago