Does solr do web crawling?

Asked 2009-11-23T05:24:21.020

I am interested to do web crawling. I was looking at solr.

Does solr do web crawling, or what are the steps to do web crawling?

solr web-crawler

Edit Report

2 Answers

You might also want to take a look at

Very powerful crawler that is compatible with Solr.

answered 2011-10-02T15:05:43.073

I have been using Nutch with Solr on my latest project and it seems to work quite nicely.

If you are using a Windows machine then I would strongly recommend following the 'No cygwin' instructions given by Jason Riffel too!

answered 2010-12-31T09:44:00.637