# XCrawl Robots.txt
User-agent: *
Allow: /
Disallow: /api/

# Sitemaps
Sitemap: https://www.xcrawl.com/sitemap.xml