My site trivandrumgospelhall.in is completely unreachable for Googlebot (Failed: Robots.txt unreachable). I have verified robots.txt exists, disabled Prerendering/Pretty URLs, and confirmed the error persists in the Google Rich Results Test. I suspect an IP block at the Netlify edge nodes for Google’s crawler range. Can you please check the logs for my site?
Just to be clear i did some chatgpt gemini and some blgs that said prerdering is issue, still issue
https://trivandrumgospelhall.in/robots.txt is reachable
User-agent: *
Allow: /
# Sitemap
Sitemap: https://trivandrumgospelhall.in/sitemap.xml
# Disallow admin areas (if any in future)
Disallow: /admin/
Disallow: /private/
# Allow all images
User-agent: Googlebot-Image
Allow: /photos/
Allow: /images/
this is coming
I don’t see an issue from our end. Try contactiing Google.
1 Like
Thanks, any body else got any other pointers, i highly doubt Google will help out here, usually if its a cache issue, it will be resolved , but same thing for 2 months. I disabled the ipv6, and observing from today.
It seems to be difficult to get Google to index sites on Netlify for whatever reasons. On many of my sites, I switched to Pagefind.