crawler: crawler.dev.java.netOverview What is the Smart and Simple Web Crawler? Smart and easy framework thats crawls a web site Integrated Lucene support It's simple to integrate the framework in own applications The crawler can start from one or from a list of links Two crawling models available: Max Iterations: Crawls a web site through a limited number of links: Fast model with a small memory footprint and cpu usage. Max
