Alex Rivera | Logout

Questions tagged web-scraping

28 questions

Sort by: Newest Votes Active
8
votes
1
answers

Parsing snippets of html with enlive

clojure web-scraping enlive
asked 2013-07-25T20:27:18.910
19
votes
2
answers

automating the login to the uk data service website in R with RCurl or httr

r curl web-scraping rcurl httr
asked 2013-07-22T01:01:44.883
8
votes
2
answers

Scrapy:In a request fails (eg 404,500), how to ask for another alternative request?

python web-scraping scrapy http-status-code-404
asked 2013-06-04T02:54:25.287
191
votes
15
answers

How do I avoid HTTP error 403 when web scraping with Python?

python http web-scraping http-status-code-403
asked 2013-05-18T17:47:06.230
10
votes
1
answers

Need to find text with RegEx and BeautifulSoup

python regex python-2.7 web-scraping beautifulsoup
asked 2013-05-07T14:02:35.600
10
votes
2
answers

Web page scraping gems/tools available in Ruby

ruby web-scraping html-parsing lxml
asked 2013-02-23T05:24:22.633
24
votes
3
answers

Obtaining reddit data

web-scraping reddit
asked 2013-01-14T16:48:33.630
10
votes
4
answers

How to fill in an online form and get results back in R

xml r forms web-scraping rselenium
asked 2013-01-09T14:17:35.807
8
votes
2
answers

Html Agility Pack, Web Scraping, and spoofing in C#

c# web-scraping html-agility-pack spoofing
asked 2012-12-22T17:56:52.120
13
votes
1
answers

Using tor and python to scrape Google Scholar

python web-scraping tor google-scholar
asked 2012-07-12T00:42:15.307
8
votes
1
answers

Is it possible to use Text or ByteString on HXT in Haskell?

haskell text web-scraping bytestring hxt
asked 2012-07-08T09:51:32.350
12
votes
3
answers

Capturing http status codes with scrapy spider

python web-scraping scrapy
asked 2012-06-11T14:46:37.483
27
votes
2
answers

How to generate the start_urls dynamically in crawling?

web-scraping scrapy web-crawler
asked 2012-02-17T02:49:01.373
18
votes
3
answers

Submit data via web form and extract the results

python web-crawler web-scraping
asked 2011-12-04T17:14:48.670
11
votes
3
answers

Parsing meta tags efficiently with lxml?

python web-scraping css-selectors lxml
asked 2011-11-15T18:54:59.053
48
votes
8
answers

Page content is loaded with JavaScript and Jsoup doesn't see it

java html web-scraping jsoup
asked 2011-09-20T17:01:18.680
9
votes
2
answers

Web scraping with R over real estate ads

xml r web-scraping rcurl
asked 2011-05-13T10:23:49.083
11
votes
6
answers

Body Text extraction from websites e.g. extract only article heading and text not all text in site

algorithm text web-scraping text-extraction
asked 2011-04-21T15:02:05.313
12
votes
3
answers

How to scrape HTTPS javascript web pages

java javascript python https web-scraping
asked 2011-04-06T05:41:46.723
12
votes
4
answers

How to automate multiple requests to a web search form using R

r web-scraping
asked 2011-03-22T19:02:46.787
67
votes
9
answers

Scrape web pages in real time with Node.js

javascript jquery node.js web-scraping
asked 2011-03-06T15:47:58.193
9
votes
3
answers

Indy - IdHttp how to handle page redirects?

delphi indy web-scraping
asked 2010-12-28T21:52:24.443
19
votes
4
answers

How can I handle Javascript in a Perl web crawler?

javascript perl web-crawler web-scraping
asked 2010-09-22T12:08:03.413
13
votes
2
answers

Using urllib and BeautifulSoup to retrieve info from web with Python

python web-scraping beautifulsoup urllib2
asked 2010-04-15T16:34:29.707
211
votes
3
answers

How can I efficiently parse HTML with Java?

java html parsing html-parsing web-scraping
asked 2010-01-30T16:52:48.033
21
votes
4
answers

Scrape web page contents

php html web-scraping curl httprequest
asked 2009-02-25T05:37:40.890
57
votes
10
answers

How do you scrape AJAX pages?

ajax web-scraping
asked 2008-11-04T01:25:26.493
11
votes
7
answers

Python regular expression for HTML parsing

python regex web-scraping beautifulsoup
asked 2008-09-10T21:49:53.900