I have a gatsby website hosted on Netlifty with my custom domain (.dev domain). The domain is managed by netlify dns.
for some reason few days ago, Google search console is sending me errors on indexing issues on some pages that the google bot is trying to access using HTTP not https. The pages should be redirected to https, and these pages work fine in the browser, however googlebot is failing to access the page and is getting a Redirect error.
I haven’t changed anything in my website since the beginning of May, but these errors started showing up suddenly on the 31st of May. I’m not sure whether this error is from the Google search console, or is it from Netlify, or is it from my site robots.txt.
My robots.txt is quite open and generic
User-agent: *
Allow: /
Sitemap: https://myWebsite.dev/sitemap.xml
Host: https://myWebsite.dev
All the pages in the sitemap.xml are listed in https too.
I’d appreciate any advice on how to proceed to fix this properly.