# robots.txt — schuntingranch.com # STATIC FILE. Maintained by hand over SFTP, at the WordPress root # (/nas/content/live/stonecreek2/ — the folder with wp-config.php). # # This file overrides any robots.txt generated by an SEO plugin. # Do not use a plugin's "create robots.txt" button — that makes a second, # competing file. Edit this one instead. # # Last updated: 2026-08-24 User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /*?s= Disallow: /search/ Disallow: /*?replytocom= # NOTE: do NOT add Disallow rules for /tag/, /category/, /author/, # /species/ or /experience/. Blocking them stops Google crawling them, # which means it can never see the noindex tag and they stay in limbo. # Those are handled with meta noindex + sitemap removal in the SEO plugin. # AI and answer-engine crawlers (GPTBot, ClaudeBot, PerplexityBot, # OAI-SearchBot, Google-Extended, CCBot, Applebot-Extended) are # intentionally NOT blocked. Generative surfaces already drive 16.4K # impressions per 6 months and are trending up. Do not add blanket AI # crawler blocks without discussing it first. # Verify after any SEO plugin change that this path is still correct. # Yoast and RankMath both default to /sitemap_index.xml. Sitemap: https://schuntingranch.com/sitemap_index.xml