# nikeid.nike.com robots.txt -- just crawl it. User-agent: * Allow: / Disallow: /*nisessionid Disallow: /*cp=