Top Web Crawling Libraries for Java
webmagic-core
0.9.0
jsoup
1.16.1
jsoup Java HTML Parser · jsoup is a Java library for working with real-world HTML. It provides a very convenient API for fetching URLs and extracting and manipulating data, using the best of HTML5 DOM methods and CSS selectors. jsoup implements the WHATWG HTML5 specification, and parses HTML to the same DOM as modern browsers do.
nutch
1.19
Apache Nutch · Nutch is an open source web-search software. It builds on Hadoop, Tika and Solr, adding web-specifics, such as a crawler, a link-graph database etc.
Advertisement
- Trends
- Latest
- Usages
- Job Scheduling
- Dependency Injection
- Code Analysis
- Configuration
- Microservice
- CSV
- Bytecode Manipulation
- Networking
- Caching
- Mocking
- Machine Learning
- Database
- Security & Crypto
- Template Engine
- Search
- Collections
- PaaS
- Code Coverage
- JSON
- Web Frameworks
- Processes
- Date and Time
- HTTP Clients
- Web Crawling
- ORM
- Monitoring
- Performance Analysis
- Reactive
- Science
- Logging
- REST Frameworks