# Allow all crawlers to index your site User-agent: * # Allow all important Next.js public assets and pages Allow: / # Block internal Next.js build folders (for safety) Disallow: /api/ Disallow: /server/ Disallow: /scripts/ Disallow: /private/ # Block unwanted file types (optional but helps keep crawl budget clean) Disallow: /*.zip$ Disallow: /*.json$ Disallow: /*.env$ Disallow: /*.log$ Disallow: /*.ts$ Disallow: /*.tsx$ # Sitemap location (add your actual sitemap path) Sitemap: https://almuqeet.net/sitemap.xml Sitemap: https://almuqeet.net/blog/post-sitemap.xml