# Sample robots.txt — samplefiles.com User-agent: * Disallow: /admin/ Disallow: /search? Disallow: /*.pdf$ Allow: /admin/public/ User-agent: GPTBot Disallow: / User-agent: Bingbot Crawl-delay: 5 Sitemap: https://example.com/sitemap.xml