Mechanize and DOMForm

Mentionable Python discovery of the day:

DOMForm is a Python module for web scraping and web testing. It knows how to evaluate embedded JavaScript code in response to appropriate events.

Basically it's a python DOM implementation with JavaScript support (using the Mozilla Spidermonkey JavaScript-C engine).

It's great for screen scraping and, apparently planned for inclusion in in Mechanize.

Mechanize

Worthy of notice is Mechanize, a stateful programmatic web browsing module. It's very useful for web unit testing.

Check it out at:

• DOMForm -- http://wwwsearch.sourceforge.net/DOMForm/
• Mechanize -- http://wwwsearch.sourceforge.net/mechanize/