A curated list of public and paid data sources that stream or update in real time, spanning finance, transport, weather, news, cybersecurity and more.
awesomedata/awesome-public-datasets
A curated, topic-organized list of high-quality open datasets spanning agriculture, biology, climate, networks, and more.
- Stars
- 79,648
- Forks
- 11,905
- Open issues
- 165
- Last commit
- 3 hours ago
What is it?
Awesome Public Datasets is a community-maintained catalog of publicly available datasets, grouped by subject area such as agriculture, architecture, biology, chemistry, climate and weather, complex networks, computer networks, and cybersecurity. Each entry links to the dataset's source along with a short description of its contents.
Most of the listed datasets are free to use, though some require registration or payment. The list is generated by a tooling pipeline, and entries carry status markers indicating whether the link is currently working. Contributions are handled through the project's separate contribution process rather than direct edits to the list.
The project originated at a Shanghai Jiao Tong University research lab and is now maintained under a community organization. It is useful as a starting point when looking for training data, research material, or benchmark sources in a specific domain.
Key features
- 01Datasets organized by topic, from agriculture and biology to climate and cybersecurity.
- 02Each entry links to the original data source with a short content description.
- 03Status markers show which links are currently working.
- 04Covers both free and some paid or registration-based datasets.
- 05Contributions follow a separate documented process.
Use cases
- Finding training data for a machine learning project in a specific domain.
- Locating benchmark or research datasets for academic work.
- Exploring what public data exists before building a data pipeline.
Things to know
- This is a curated list of dataset links rather than installable software, so there is nothing to run.
- Some listed datasets are not free, as the README notes.
- The README says the file is auto-generated and should not be edited directly, so contributions go through a separate process.
Topics
FAQ
- What is awesome-public-datasets?
- A curated, topic-organized list of high-quality open datasets spanning agriculture, biology, climate, networks, and more. Awesome Public Datasets is a community-maintained catalog of publicly available datasets, grouped by subject area such as agriculture, architecture, biology, chemistry, climate and weather, complex networks, computer networks, and cybersecurity. Each entry links to the dataset's source along with a short description of its contents.
- Is awesome-public-datasets free to use? What license does it have?
- awesome-public-datasets is open source under the MIT license. Check the license terms before using it in commercial products.
- Is awesome-public-datasets still maintained?
- Actively maintained. The last commit to awesome-public-datasets was on Oct 20, 2026.
- What can I use awesome-public-datasets for?
- Finding training data for a machine learning project in a specific domain. Locating benchmark or research datasets for academic work. Exploring what public data exists before building a data pipeline.
- Where can I get awesome-public-datasets?
- The source code and installation instructions are on GitHub: https://github.com/awesomedata/awesome-public-datasets
Summary generated by AI from the project's README. GitHub stats refresh daily.
Related projects
A curated list of open source libraries for deploying, monitoring, versioning, scaling and securing production machine learning.
A curated Markdown list of English-speaking YouTube channels that teach programming, web development, machine learning, cybersecurity and other tech topics.
An LLM agent framework from Microsoft that automates data-driven R&D tasks such as reading papers, implementing models and factors, and running Kaggle-style experiments.
A free, self-paced 9-week online course covering MLOps: experiment tracking, orchestration, deployment, monitoring and best practices.
A curated Chinese-language guide to ChatGPT and frontier LLMs, covering usage, prompting, app development, agents, and productivity tools.