Home » Categories » Web Crawlers

Web Crawlers
Sort by:Popular▼

1.Apache Nutch3 usages

org.apache.nutch » nutch Apache

Apache Nutch
Last Release on Feb 17, 2026

2.Crawljax Core8 usages

com.crawljax » crawljax-core Apache

Crawljax Core
Last Release on Jun 1, 2023

3.Norconex HTTP Collector

com.norconex.collectors » norconex-collector-http Apache

Norconex HTTP Collector is a web spider, or crawler that aims to be very flexible, easy to extend, and portable
Last Release on May 25, 2025

4.WebMagic Parent

us.codecraft » webmagic-parent Apache

A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, content extraction and persistent.
Last Release on Apr 23, 2024

5.Crawler4j17 usages

edu.uci.ics » crawler4j Apache

Open Source Web Crawler for Java
Last Release on Mar 26, 2018

6.Crawler Commons8 usages

com.google.code.crawler-commons » crawler-commons Apache

crawler-commons is a set of reusable Java components that implement functionality common to any web crawler.
Last Release on Oct 10, 2014

7.WebCollector7 usages

cn.edu.hfut.dmic.webcollector » WebCollector GPL

A java crawler for information collection
Last Release on Sep 7, 2017

8.Gecco4 usages

com.geccocrawler » gecco MIT

Easy to use lightweight web crawler
Last Release on Jul 4, 2020

9.Charles1 usages

com.amihaiemil.web » charles BSD

Charles is a smart web crawling library.
Last Release on Jan 29, 2017

10.Crawler1 usages

com.soulgalore » crawler Apache

Simple java (1.6) crawler to crawl web pages on one and same domain.
Last Release on Feb 8, 2014