# don't crawl www2 -- remove before launch User-agent: * Allow: /map.asp Allow: /view.aspx.asp