Web Crawlers
2.Crawljax Core8 usages
com.crawljax » crawljax-core Apache
Crawljax Core
Last Release on Jun 1, 2023
Norconex HTTP Collector is a web spider, or crawler that aims to be very flexible, easy to extend, and portable
Last Release on May 25, 2025
4.WebMagic Parent
us.codecraft » webmagic-parent Apache
A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, content
extraction and persistent.
Last Release on Apr 23, 2024
5.Crawler4j17 usages
edu.uci.ics » crawler4j Apache
Open Source Web Crawler for Java
Last Release on Mar 26, 2018
crawler-commons is a set of reusable Java components that implement
functionality common to any web crawler.
Last Release on Oct 10, 2014
7.Crawler1 usages
com.soulgalore » crawler Apache
Simple java (1.6) crawler to crawl web pages on one and same domain.
Last Release on Feb 8, 2014
8.BUbiNG1 usages
it.unimi.di.law » bubing Apache
BUbiNG is an open-source Java fully distributed crawler
Last Release on Apr 19, 2019
9.Crawljax4 usages
com.crawljax » crawljax Apache
Crawling Ajax applications through dynamic analysis and
reconstruction of the UI state changes. Crawljax is based on a
method which dynamically builds a `state-flow graph' modeling
the various navigation paths and states within an ...
Last Release on Dec 31, 2012
Relocated → com.crawljax »
crawljax-core
10.Storm Crawler
com.digitalpebble » storm-crawler Apache
A collection of resources for building low-latency, scalable web crawlers on Apache Storm.
Last Release on Nov 3, 2015