# robots.txt for VLT Markets (vltmarkets.com) # Optimized for Web Indexers & Generative AI Search Engines (GEO & AEO) User-agent: * Allow: / Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /api/private/ # Explicit permissions for Generative AI & Answer Engine crawlers User-agent: Googlebot Allow: / User-agent: Google-Extended Allow: / User-agent: GPTBot Allow: / User-agent: PerplexityBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Applebot-Extended Allow: / User-agent: CCBot Allow: / User-agent: Bingbot Allow: / # Sitemap & LLM knowledge indexing Sitemap: https://vltmarkets.com/sitemap.xml llms-txt: https://vltmarkets.com/llms.txt llms-full-txt: https://vltmarkets.com/llms-full.txt