Funnelweb

---------------------

- Add ignore_re attribute for titleguess pipeline [ivanteoh]
- Move sitemapper pipeline between indexguess and titleguess [ivanteoh]
- Add default pages attribute for indexguess pipeline [ivanteoh]

------------------
- fix an issue in setup.py that broke buildout

----------------

- set default pipeline so can be used without buildout [djay]
- better documentation [djay]
- change recommended way to use funnelweb [djay]
- new sitemapper step [djay]
- can now crawl get requests [djay]
- various fixes in transmogrify.* dependencies. see change logs [djay]

----------------

- fix default cmd line pipeline to funnelweb.remote
- remove runner code and checkin ttw.cfg
- funnelweb now depends on mr.migrator
- improve urltidy to handle .asp .php
- include index.asp and index.php as default pages
- handle override pipeline in buildout
- add --show-pipeline command
- fix handling of --pipeline

------------------
- fix bug in commandline overrides
- only open cache files when needed so don't run out of handles
- follow http-equiv refresh links
- don't strip html head

------------------

- turn off templateauto by default
- added hideguess step. currently just manual setting of what to hide
- multiline value overrides possible from commandline
- files use file pointers to reduce memory usage
- cache saves .metadata files to record and playback headersx
- ploneremote: fix bug in debug output
- show error if text is None
- fix bug with bad chars in rewritten links
- fix bug in losing items
- templates: handle '/text()' in xpaths
- templates: new 'optionaltext' rule format
- set default page on the import root