jar

com.github.xjtushilei : scriptspider

Maven & Gradle

Mar 30, 2018
163 stars

scriptspider · ScriptSpider(SS) is a Java distributed crawler framework that supports hot swappable components. SS是一个java版本的分布式的通用爬虫,可以热插拔各个组件(提供默认的),自动切换代理,自动结构化数据与存储。使用redis,分布式调度等技术。

Table Of Contents

Latest Version

Download com.github.xjtushilei : scriptspider JAR file - Latest Versions:

All Versions

Download com.github.xjtushilei : scriptspider JAR file - All Versions:

Version Vulnerabilities Size Updated
0.3
0.2
0.1.x
0.0.x

View Java Class Source Code in JAR file

  1. Download JD-GUI to open JAR file and explore Java source code file (.class .java)
  2. Click menu "File → Open File..." or just drag-and-drop the JAR file in the JD-GUI window scriptspider-0.3.jar file.
    Once you open a JAR file, all the java classes in the JAR file will be displayed.

com.github.xjtushilei.core.pageprocesser.PreDefine

├─ com.github.xjtushilei.core.pageprocesser.PreDefine.TextPageProcessor.class - [JAR]

com.github.xjtushilei.core.downloader.PreDefine

├─ com.github.xjtushilei.core.downloader.PreDefine.HttpClientPoolDownloader.class - [JAR]

com.github.xjtushilei.core.scheduler.PreDefine

├─ com.github.xjtushilei.core.scheduler.PreDefine.PriorityQueueScheduler.class - [JAR]

├─ com.github.xjtushilei.core.scheduler.PreDefine.QueueScheduler.class - [JAR]

├─ com.github.xjtushilei.core.scheduler.PreDefine.RedisScheduler.class - [JAR]

com.github.xjtushilei.example.百科名医

├─ com.github.xjtushilei.example.百科名医.百科名医爬虫入口.class - [JAR]

├─ com.github.xjtushilei.example.百科名医.结果保存器.class - [JAR]

├─ com.github.xjtushilei.example.百科名医.页面解析器.class - [JAR]

com.github.xjtushilei.model

├─ com.github.xjtushilei.model.Page.class - [JAR]

├─ com.github.xjtushilei.model.RegexRule.class - [JAR]

├─ com.github.xjtushilei.model.UrlSeed.class - [JAR]

com.github.xjtushilei.contentextractor

├─ com.github.xjtushilei.contentextractor.ContentExtractor.class - [JAR]

com.github.xjtushilei.core

├─ com.github.xjtushilei.core.Spider.class - [JAR]

com.github.xjtushilei.example

├─ com.github.xjtushilei.example.MiniRegexSpider.class - [JAR]

├─ com.github.xjtushilei.example.MiniSpider.class - [JAR]

├─ com.github.xjtushilei.example.PriorityQueueSpider.class - [JAR]

├─ com.github.xjtushilei.example.RedisSpider.class - [JAR]

├─ com.github.xjtushilei.example.SimpleSpider.class - [JAR]

com.github.xjtushilei.core.pageprocesser

├─ com.github.xjtushilei.core.pageprocesser.PageProcessor.class - [JAR]

com.github.xjtushilei.utils

├─ com.github.xjtushilei.utils.HttpUtils.class - [JAR]

├─ com.github.xjtushilei.utils.JsonUtils.class - [JAR]

├─ com.github.xjtushilei.utils.RedisUtils.class - [JAR]

├─ com.github.xjtushilei.utils.TimeSleep.class - [JAR]

com.github.xjtushilei.core.scheduler

├─ com.github.xjtushilei.core.scheduler.Scheduler.class - [JAR]

com.github.xjtushilei.core.saver

├─ com.github.xjtushilei.core.saver.Saver.class - [JAR]

com.github.xjtushilei.core.downloader

├─ com.github.xjtushilei.core.downloader.Downloader.class - [JAR]

com.github.xjtushilei.core.saver.PreDefine

├─ com.github.xjtushilei.core.saver.PreDefine.ConsoleSaver.class - [JAR]