Repolode
Submit
apache

apache/pinot

A real-time distributed OLAP datastore for low-latency analytics over streaming and batch data, ingesting from Kafka and S3.

Open-source alternative to:Google BigQueryAmazon Redshift

View on GitHubWebsite
Stars
6,161
Forks
1,526
Open issues
1,304
Last commit
yesterday

What is it?

Apache Pinot is a real-time distributed OLAP datastore built for analytics queries with low latency on large volumes of data. It ingests from stream sources such as Apache Kafka, Apache Pulsar and AWS Kinesis, as well as batch sources such as Hadoop HDFS, Amazon S3, Azure ADLS and Google Cloud Storage, and can combine both into a single table.

Pinot is a column-oriented store with pluggable indexes, including inverted, range, Bloom filter, text, JSON, geospatial and StarTree indexes. Queries are written in SQL and can be sent through a built-in query console or a REST API. Upsert during real-time ingestion is supported, along with multitenancy for isolating data in logical namespaces.

The project is written in Java and can be deployed as a horizontally scalable cluster, with a Helm chart for Kubernetes. It is aimed at user-facing analytics and time series workloads with many dimensions and metrics, where aggregations must return quickly.

Key features

  • 01Real-time ingestion from Kafka, Pulsar and Kinesis, plus batch ingestion from S3 and HDFS.
  • 02SQL query interface with a built-in query console and REST API.
  • 03Pluggable indexes including inverted, range, text, JSON, geospatial and StarTree.
  • 04Upsert support during real-time ingestion.
  • 05Multitenancy for isolating data in logical namespaces.
  • 06Helm chart for deploying a clustered setup on Kubernetes.

Use cases

  • User-facing analytics dashboards that need interactive query latency.
  • Time series analysis over large event streams with many dimensions and metrics.
  • Combining real-time Kafka data with historical batch data for a unified query table.

Topics

#olap#real-time-analytics#sql#kafka#distributed-systems#java#data-warehouse

FAQ

What is pinot?
A real-time distributed OLAP datastore for low-latency analytics over streaming and batch data, ingesting from Kafka and S3. Apache Pinot is a real-time distributed OLAP datastore built for analytics queries with low latency on large volumes of data. It ingests from stream sources such as Apache Kafka, Apache Pulsar and AWS Kinesis, as well as batch sources such as Hadoop HDFS, Amazon S3, Azure ADLS and Google Cloud Storage, and can combine both into a single table.
Is pinot free to use? What license does it have?
pinot is open source under the Apache-2.0 license. Check the license terms before using it in commercial products.
Is pinot still maintained?
Actively maintained. The last commit to pinot was on Oct 17, 2026.
What can I use pinot for?
User-facing analytics dashboards that need interactive query latency. Time series analysis over large event streams with many dimensions and metrics. Combining real-time Kafka data with historical batch data for a unified query table.
Where can I get pinot?
The source code and installation instructions are on GitHub: https://github.com/apache/pinot

Summary generated by AI from the project's README. GitHub stats refresh daily.

Related projects