Repolode

#arrow

Best open-source columnar DataFrame and query engines (2026)

These tools run queries and transformations over tabular data in columnar memory, which is often much faster than row-by-row code on large datasets. When choosing one, decide whether you need a drop-in replacement for an existing stack like pandas or Spark, or a new engine you call directly, and whether you have NVIDIA GPUs. polars is a fast Rust engine with Python, Node.js, R and SQL bindings. cudf runs pandas-style code on GPUs, often with no code changes. sail runs existing PySpark code over Spark Connect.

6 repositories