Search engine indexing

Hello!

I’m a newbie and trying to find out how to index/crawl .netlify.app to Google. I dont have a custom domain yet, if that helps.

My files are only HTML, CSS, and Javascript. Stored in Github but deployed in Netlify.

I would really appreciate if someone can share the steps I need to do so that the .netlify.app site will be searchable. Thanks in advance!

Hey @jxxe, welcome!

You need to get Google to crawl your website, that is if your HTML is allowing it to crawl.

There are multiple options, check out this link:

Keep in mind it can take some time/days before it actually is being crawled once you’ve followed these steps.

Gr,

Andy

1 Like

Thanks @andylemaire.

I verified the site (main page url) on google console and opted to use add the html meta tag for verification. When I add the xml sitemap, it says ‘Sitemap could not be read’.

Does successful verification and a “valid” sitemap submitted make the .netlify.app webiste crawled?

Hi @jxxe,

It should be yes, unless you’ve configured noindex or blocked it in robots.txt.

Gr,

Andy

1 Like

I don’t have a robots.tx file, atleast didn’t create nor worked on something like that… Btw, I just read a guide on ‘Sitemap could not be read’ thing that it can mean ‘pending’. So I guess it’s a waiting game for now.

Just a side question, is there a need to verify in Google Console every single url I want indexed? Particularly those I added on the sitemap?

Google will crawl your website automatically for linked pages, read your sitemap, …
Verifying every single url isn’t needed, but it will speed up the process of indexing a little bit.

Gr,

Andy

1 Like