# Block all but AdsBot crawlers
User-agent: * Disallow: /