DOC

io.github.jasperroel : SiteCrawler

Maven & Gradle

Jul 30, 2018
21 stars

SiteCrawler · This project provides a simple WebCrawler with retry-capabilities, functionality to distinguish between http/https sites. It biggest feature is that it allows for plugins (or CrawlerActions), which allows you to hook your scripts into the crawling process. It also allow for setting "blocked" URLs. Those URLs or patterns will not be crawled.

Table Of Contents

Latest Version

Download io.github.jasperroel : SiteCrawler Javadoc & API Documentation - Latest Versions:

All Versions

Download io.github.jasperroel : SiteCrawler Javadoc & API Documentation - All Versions:

Version Size Javadoc Updated
1.0.x

How to open Javadoc JAR file in web browser

  1. Rename the file SiteCrawler-1.0.0-javadoc.jar to SiteCrawler-1.0.0-javadoc.zip
  2. Use your favourite unzip tool (WinRAR / WinZIP) to extract it, now you have a folder SiteCrawler-1.0.0-javadoc
  3. Double click index.html will open the index page on your default web browser.

How to generate Javadoc from a source JAR?

Running the command javadoc:

javadoc --ignore-source-errors -encoding UTF-8 -sourcepath "SiteCrawler-1.0.0-sources.jar" -d "SiteCrawler-1.0.0-javadoc" -subpackages 

Advertisement

Dependencies from Group

Jul 30, 2018
21 stars

Discover Dependencies

Sep 26, 2018
Feb 27, 2023
1 usages
106 stars
Jan 27, 2020
1 usages
Aug 15, 2023
2 usages
0 stars
Mar 09, 2023
2 usages
Aug 02, 2018
Jan 19, 2023
3 usages
12k stars
mln
Jul 14, 2020
1 usages
Aug 06, 2018
1 usages
2 stars