Repolode
Submit
NaiboWang

NaiboWang/EasySpider

A visual, code-free web crawler and browser automation tool where you design data collection tasks by clicking elements on a web page.

Open-source alternative to:OctoparseParseHub

View on GitHubWebsite
Stars
44,721
Forks
5,394
Open issues
274
Last commit
2 days ago

What is it?

EasySpider is a desktop application for browser automation and web data collection. Instead of writing scripts, you select the elements you want on a page, and the tool generates a task that can be run and reused. It supports automatic detection of similar blocks, such as product listings, so a whole list can be selected and its child fields extracted in one step.

Tasks are built as flowcharts that can include loops (for example, clicking each link to open detail pages or paging through results), conditional branches, text input, screenshots, and custom JavaScript. Collected data is saved by field. The project also provides a command-line mode so finished tasks can be run from other systems.

The project is licensed under AGPL-3.0 and is built with Electron. Documentation is hosted on the project's GitHub Wiki, and sample tasks are included in the repository's Examples folder.

Key features

  • 01Select page elements by clicking, with similar items matched automatically.
  • 02Build collection flows as flowcharts with loops, conditions and text input.
  • 03Loop through list items to open and collect detail pages.
  • 04Save extracted data split by field.
  • 05Run tasks from the command line for integration with other systems.
  • 06Add custom JavaScript steps to tasks.

Use cases

  • Collecting product listings and details from e-commerce sites without writing code.
  • Scraping public web pages into structured data for analysis.
  • Automating repetitive browser operations as scheduled or batch tasks.
  • Prototyping a scraper before deciding whether to write custom code.

Quick start

  1. 1

    Download the latest version from the Releases Page

  2. 2

    Open the downloaded EasySpider app and design tasks by clicking elements on the page

Things to know

  • Its AGPL-3.0 license requires derivative works and network-served modifications to be released under the same license.
  • The README's sponsor and promotional sections are not relevant to installation, and the software is provided as is with no warranty.

Topics

#web-scraping#crawler#no-code#browser-automation#data-collection#visual-programming#electron#batch-processing#batch-script#code-free

FAQ

What is EasySpider?
A visual, code-free web crawler and browser automation tool where you design data collection tasks by clicking elements on a web page. EasySpider is a desktop application for browser automation and web data collection. Instead of writing scripts, you select the elements you want on a page, and the tool generates a task that can be run and reused. It supports automatic detection of similar blocks, such as product listings, so a whole list can be selected and its child fields extracted in one step.
Is EasySpider free to use? What license does it have?
EasySpider is open source under the AGPL-3.0 license. Check the license terms before using it in commercial products.
Is EasySpider still maintained?
Actively maintained. The last commit to EasySpider was on Oct 19, 2026.
What can I use EasySpider for?
Collecting product listings and details from e-commerce sites without writing code. Scraping public web pages into structured data for analysis. Automating repetitive browser operations as scheduled or batch tasks. Prototyping a scraper before deciding whether to write custom code.
How do I install EasySpider?
Download the latest version from the Releases Page Open the downloaded EasySpider app and design tasks by clicking elements on the page
Where can I get EasySpider?
The source code and installation instructions are on GitHub: https://github.com/NaiboWang/EasySpider

Summary generated by AI from the project's README. GitHub stats refresh daily.

Related projects