Repolode
Submit
bytewax

bytewax/awesome-public-real-time-datasets

A curated list of public and paid data sources that stream or update in real time, spanning finance, transport, weather, news, cybersecurity and more.

View on GitHubWebsite
Stars
2,954
Forks
259
Open issues
22
Last commit
3 months ago

What is it?

This is an awesome-style list of sources that deliver live data over HTTP polling, WebSockets, or streaming protocols. Entries are split into free and paid tiers and grouped loosely by domain, including crypto and stock market feeds, transit and vehicle tracking, weather and environmental sensors, news APIs, threat intelligence feeds, and sports scores.

Each entry links to the provider's documentation and gives a short note on what the feed contains and how it is accessed, such as WebSocket endpoints, REST APIs, or Kafka-format streams. Some entries also flag limits, like free tiers with rate caps or data delays.

The list is useful for developers building streaming pipelines, dashboards, or prototypes who need a real data source to test against, and it also includes a few synthetic data generators for testing without external feeds.

Key features

  • 01Covers crypto, stock, forex and other market data feeds via WebSocket or REST
  • 02Includes transit, rail, aviation and maritime tracking sources
  • 03Lists weather, air quality, seismic and environmental sensor feeds
  • 04Separates free sources from paid commercial providers
  • 05Adds threat intelligence feeds and synthetic data generators for testing

Use cases

  • Finding a live market data feed to prototype a trading dashboard
  • Sourcing real-time transit or weather data for a streaming pipeline demo
  • Generating synthetic event streams to test Kafka or Pulsar consumers

Things to know

  • Many listed sources have rate-limited free tiers or require paid plans or API keys.
  • Some entries are beta or unofficial, and some need scraping, so they may change or break without notice.

Topics

#real-time#streaming#datasets#open-data#websocket#api#finance#iot#awesome-list#data

FAQ

What is awesome-public-real-time-datasets?
A curated list of public and paid data sources that stream or update in real time, spanning finance, transport, weather, news, cybersecurity and more. This is an awesome-style list of sources that deliver live data over HTTP polling, WebSockets, or streaming protocols. Entries are split into free and paid tiers and grouped loosely by domain, including crypto and stock market feeds, transit and vehicle tracking, weather and environmental sensors, news APIs, threat intelligence feeds, and sports scores.
Is awesome-public-real-time-datasets free to use? What license does it have?
awesome-public-real-time-datasets is open source under the CC0-1.0 license. Check the license terms before using it in commercial products.
Is awesome-public-real-time-datasets still maintained?
Updated within 6 months. The last commit to awesome-public-real-time-datasets was on Jul 10, 2026.
What can I use awesome-public-real-time-datasets for?
Finding a live market data feed to prototype a trading dashboard Sourcing real-time transit or weather data for a streaming pipeline demo Generating synthetic event streams to test Kafka or Pulsar consumers
Where can I get awesome-public-real-time-datasets?
The source code and installation instructions are on GitHub: https://github.com/bytewax/awesome-public-real-time-datasets

Summary generated by AI from the project's README. GitHub stats refresh daily.

Related projects