# DRIFT crawl policy User-agent: * Allow: / # Low-value / utility (save crawl budget) Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-login.php Disallow: /?s= Disallow: /*?s= Disallow: /*?p= Disallow: /*?attachment_id= Disallow: /*?replytocom= Disallow: /feed/ Disallow: /*/feed/ Disallow: /comments/feed/ Disallow: /trackback/ Disallow: /*/trackback/ # REST API. Carries no search value and was 13% of Googlebot's requests. # /wp-json/ alone returns ~650KB and /wp-json/wp/v2/posts ~240KB per fetch. Disallow: /wp-json/ Disallow: /*?rest_route= Disallow: /*&rest_route= # oEmbed endpoints duplicate article content as JSON Disallow: /*?embed= Disallow: /*/embed/ Sitemap: https://driftzine.com/sitemap_index.xml Sitemap: https://driftzine.com/news-sitemap.xml