User-agent: * Disallow: / User-agent: facebookexternalhit Allow: / User-agent: Facebot Allow: / User-agent: Googlebot Allow: / User-agent: Googlebot-Image Allow: / User-agent: Googlebot-Mobile Allow: / User-agent: Googlebot-News Allow: / User-agent: Googlebot-Video Allow: / User-agent: Mediapartners-Google Allow: / User-agent: AdsBot-Google Allow: /