Home » com.github.crawler-commons » crawler-commons » Used By

Crawler Commons

crawler-commons is a set of reusable Java components that implement functionality common to any web crawler.

Artifacts using Crawler Commons (21)
Sort by:Popular▼

11.Squirrel API3 usages

org.dice-research » squirrel.api AGPL

Squirrel API
Last Release on Nov 2, 2020

12.Apache Nutch3 usages

org.apache.nutch » nutch Apache

Apache Nutch
Last Release on Feb 17, 2026

13.Component Runtime :: Documentation2 usages

org.talend.sdk.component » documentation Apache

Actually framework documentation, generated as a website and pushed to Github pages.
Last Release on Jun 19, 2026

14.Page Analyzer1 usages

lt.tokenmill.crawling » page-analyzer Apache

Page Analyzer
Last Release on Sep 19, 2017

15.Ocula Extension

cn.har01d » ocula-extension MIT

Ocula Extension
Last Release on Sep 7, 2021

16.Cuzz22000

com.frogfront » web-crawler Apache

Web Crawler Library (Domain BOT)
Last Release on Apr 22, 2020

17.Mesh Portal E2E Tests

com.gentics.mesh.portal » mesh-portal-e2e-tests

Mesh Portal E2E Tests
Last Release on Jun 4, 2020

18.Testsuite Add Ons

com.xceptance » testsuite-addons

A library providing platform and vendor specific utilities for load test suites.
Last Release on Jun 19, 2025

19.Glean

io.github.kashif-mehmood-km » glean MIT

A Tavily-equivalent Kotlin library for web search, content extraction, site crawling, and URL discovery. No API keys required.
Last Release on Mar 25, 2026

20.Slit

io.github.kashif-mehmood-km » slit MIT

A Tavily-equivalent Kotlin library for web search, content extraction, site crawling, and URL discovery. No API keys required.
Last Release on Mar 25, 2026