Disallowed files and directories in robots.txt:
http://www.google.com/news?output=xhtml&
http://www.google.com/search
http://www.google.com/groups
http://www.google.com/images
http://www.google.com/catalogs
http://www.google.com/catalogues
http://www.google.com/news
http://www.google.com/nwshp
http://www.google.com/?
http://www.google.com/addurl/image?
http://www.google.com/pagead/
http://www.google.com/relpage/
http://www.google.com/relcontent
http://www.google.com/sorry/
http://www.google.com/imgres
http://www.google.com/keyword/
http://www.google.com/u/
http://www.google.com/univ/
http://www.google.com/cobrand
http://www.google.com/custom
http://www.google.com/advanced_group_search
http://www.google.com/advanced_search
http://www.google.com/googlesite
http://www.google.com/preferences
http://www.google.com/setprefs
http://www.google.com/swr
http://www.google.com/url
http://www.google.com/default
http://www.google.com/m?
http://www.google.com/m/search?
http://www.google.com/wml?
http://www.google.com/wml/search?
http://www.google.com/xhtml?
http://www.google.com/xhtml/search?
http://www.google.com/xml?
http://www.google.com/imode?
http://www.google.com/imode/search?
http://www.google.com/jsky?
http://www.google.com/jsky/search?
http://www.google.com/pda?
http://www.google.com/pda/search?
http://www.google.com/sprint_xhtml
http://www.google.com/sprint_wml
http://www.google.com/pqa
http://www.google.com/palm
http://www.google.com/gwt/
http://www.google.com/purchases
http://www.google.com/hws
http://www.google.com/bsd?
http://www.google.com/linux?
http://www.google.com/mac?
http://www.google.com/microsoft?
http://www.google.com/unclesam?
http://www.google.com/answers/search?q=
http://www.google.com/local?
http://www.google.com/local_url
http://www.google.com/froogle?
http://www.google.com/products?
http://www.google.com/froogle_
http://www.google.com/product_
http://www.google.com/products_
http://www.google.com/print
http://www.google.com/books
http://www.google.com/patents?
http://www.google.com/scholar?
http://www.google.com/complete
http://www.google.com/sponsoredlinks
http://www.google.com/videosearch?
http://www.google.com/videopreview?
http://www.google.com/videoprograminfo?
http://www.google.com/maps?
http://www.google.com/mapstt?
http://www.google.com/mapslt?
http://www.google.com/translate?
http://www.google.com/ie?
http://www.google.com/sms/demo?
http://www.google.com/katrina?
http://www.google.com/blogsearch?
http://www.google.com/blogsearch/
http://www.google.com/blogsearch_feeds
http://www.google.com/advanced_blog_search
http://www.google.com/reader/
http://www.google.com/uds/
http://www.google.com/chart?
http://www.google.com/transit?
http://www.google.com/mbd?
http://www.google.com/extern_js/
http://www.google.com/calendar/feeds/
http://www.google.com/calendar/ical/
http://www.google.com/cl2/feeds/
http://www.google.com/cl2/ical/
http://www.google.com/coop/directory
http://www.google.com/coop/manage
http://www.google.com/trends?
http://www.google.com/trends/music?
http://www.google.com/notebook/search?
http://www.google.com/music
http://www.google.com/browsersync
http://www.google.com/call
http://www.google.com/archivesearch?
http://www.google.com/archivesearch/url
http://www.google.com/archivesearch/advanced_search
http://www.google.com/base/search?
http://www.google.com/base/reportbadoffer
http://www.google.com/base/s2
http://www.google.com/urchin_test/
http://www.google.com/movies?
http://www.google.com/codesearch?
http://www.google.com/codesearch/feeds/search?
http://www.google.com/wapsearch?
http://www.google.com/safebrowsing
http://www.google.com/reviews/search?
http://www.google.com/orkut/albums
http://www.google.com/jsapi
http://www.google.com/views?
http://www.google.com/c/
http://www.google.com/cbk
http://www.google.com/recharge/dashboard/car
http://www.google.com/recharge/dashboard/static/
http://www.google.com/translate_s?
http://www.google.com/s2
http://www.google.com/transconsole/portal/
http://www.google.com/gcc/
http://www.google.com/aclk