D7net
Home
Console
Upload
information
Create File
Create Folder
About
Tools
:
/
home
/
cheaflhx
/
remotelifehub.com
/
Filename :
robots.txt
back
Copy
# ============================================================ # robots.txt for https://remotelifehub.com # Optimized for Google Search + Google AdSense + WordPress SEO # ============================================================ User-agent: * Allow: / Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /wp-content/cache/ Disallow: /wp-content/plugins/ Disallow: /cgi-bin/ Disallow: /xmlrpc.php Disallow: /trackback/ Disallow: /?s= Disallow: /*?replytocom Disallow: /wp-login.php Allow: /wp-admin/admin-ajax.php # Google crawlers User-agent: Googlebot Allow: / User-agent: Googlebot-Mobile Allow: / User-agent: Googlebot-Image Allow: /wp-content/uploads/ User-agent: Googlebot-News Allow: / # Google AdSense crawlers User-agent: Mediapartners-Google Allow: / User-agent: AdsBot-Google Allow: / User-agent: AdsBot-Google-Mobile Allow: / # Other common crawlers User-agent: Bingbot Allow: / User-agent: Slurp Allow: / User-agent: DuckDuckBot Allow: / User-agent: Baiduspider Allow: / Sitemap: https://remotelifehub.com/sitemap_index.xml # Notes: # - Allows all public content to be crawled # - Blocks admin and internal endpoints # - Ensures image and mobile crawlers can index media