I want to create a web __scraper__ application and i want to do it with webbrowser control, htmlagilitypack and xpath.

right now i managed to create xpath generator(I used webbrowser for this purpose), which works fine, but sometimes I cannot grab dynamically (via javascript or ajax) generated content. Also I found out that when webbrowser control(actually IE browser) generates some extra tags like "tbody", while again htmlagilitypack `htmlWeb.Load(webBrowser.DocumentStream);` doesn't see it.

another note. I found out that following code actually grabs current webpage source, but I couldn't supply with it the htmlagilitypack `(mshtml.IHTMLDocument3)webBrowser.Document.DomDocument;`

Can you please help me with it?

c# html-agility-pack dynamic-content
Edit
Report