A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, content extraction and persistent. It can simply the development of a specific crawler.
VersionVulnerabilitiesRepositoryUsagesDate
0.10.x
0.10.3Central
0
Apr 23, 2024
0.10.2Central
0
Apr 23, 2024
0.10.1Central
0
Apr 23, 2024
0.10.0Central
0
Dec 05, 2023
0.9.x
0.9.1Central
0
Sep 10, 2023
0.9.0Central
0
Jun 22, 2023
0.8.x
0.8.0Central
0
Nov 23, 2022
0.7.x
0.7.6Central
0
Oct 23, 2022
0.7.5Central
0
Jul 22, 2021
0.7.4Central
0
Oct 26, 2020
0.7.3Central
0
Jul 30, 2017
0.7.2Central
0
Jun 17, 2017
0.7.1Central
0
Jun 03, 2017
0.7.0Central
0
May 29, 2017
0.7.0.alphaCentral
0
May 20, 2017
0.6.x
0.6.1Central
0
Jan 21, 2017
0.6.0Central
0
Dec 17, 2016
0.5.x
0.5.3Central
0
Jan 21, 2016
0.5.2Central
0
Jun 04, 2014
0.5.1Central
0
May 02, 2014
0.5.0Central
0
Apr 27, 2014
0.4.x
0.4.3Central
0
Mar 12, 2014
0.4.2Central
0
Dec 03, 2013
0.4.1Central
0
Nov 28, 2013
0.4.0Central
0
Nov 11, 2013
0.3.x
0.3.2Central
0
Sep 23, 2013
0.3.1Central
0
Sep 08, 2013
0.3.0Central
0
Sep 04, 2013
0.2.x
0.2.1Central
0
Aug 20, 2013