# *.nike.com robots.txt -- just crawl it. # used for services and components, selectively disable crawl traffic User-agent: * Disallow: