一个支持分布式的可以高效开发且可以高效运行的爬虫框架。设计思想上融合了spring与scrapy的优点。An powerful,agile,powerful,distributed crawler framework.
License | Apache 2.0 |
---|---|
Date | Jan 11, 2017 |
Files | pom (4 KB) jar (94 KB) View All |
Repositories | CentralSonatype |
Ranking | #378072 in MvnRepository (See Top Artifacts) |
Vulnerabilities | Vulnerabilities from dependencies: CVE-2023-26049 CVE-2023-26048 CVE-2023-20863 View 30 more ... |
Compile Dependencies (13)
Category/License | Group / Artifact | Version | Updates | |
---|---|---|---|---|
Apache 2.0 | cn.wanghaomiao » JsoupXpath | 0.3.2 | 2.5.3 | |
JSON Lib Apache 2.0 | com.alibaba » fastjson2 vulnerabilities | 1.2.6 | 2.0.50 | |
HTTP Clients Apache 2.0 | com.squareup.okhttp3 » okhttp | 3.3.1 | 4.12.0 | |
CLI Parser Apache 2.0 | commons-cli » commons-cli | 1.2 | 1.7.0 | |
Core Utils Apache 2.0 | org.apache.commons » commons-lang3 | 3.3.2 | 3.14.0 | |
HTTP Clients Apache 2.0 | org.apache.httpcomponents » httpclient3 vulnerabilities | 4.3.1 | 5.3.1 | |
HTTP Clients Apache 2.0 | org.apache.httpcomponents » httpcore | 4.3.1 | 5.2.4 | |
Web Server Apache 2.0EPL 2.0 | org.eclipse.jetty » jetty-server12 vulnerabilities | 9.2.0.RC0 | 12.0.9 | |
Logging MIT | org.slf4j » slf4j-ext1 vulnerability | 1.7.9 | 2.0.13 | |
Logging MIT | org.slf4j » slf4j-api | 1.7.9 | 2.0.13 | |
Core Utils Apache 2.0 | org.springframework » spring-core14 vulnerabilities | 4.1.5.RELEASE | 6.1.6 | |
Dep Injection Apache 2.0 | org.springframework » spring-context1 vulnerability | 4.1.5.RELEASE | 6.1.6 | |
Redis Client MIT | redis.clients » jedis | 2.7.3 | 5.1.2 |
Test Dependencies (1)
Licenses
License | URL |
---|---|
The Apache Software License, Version 2.0 | http://www.apache.org/licenses/LICENSE-2.0.txt |
Developers
Name | Dev Id | Roles | Organization | |
---|---|---|---|---|
Haomiao Wang | et.tw<at>163.com | wanghaomiao.cn |