[Support Guide] Understanding and debugging prerendering

Any chance we can the Embedly crawler to the list?

“Mozilla/5.0 (compatible; Embedly/0.2; +http://support.embed.ly/)”.


I have an interesting issue with pre-rendering not working.

Here is the issue I’ve created yesterday.

To summarize here, pre-rendering seems to be broken with any url ending with a path-param containing a dot ("."). I’m unable to reproduce locally using Netlify’s fork of prerender.

More details can be found in the issue link above.

Please help.

Hey there, @david_opbase :wave: I have looped in the Support team. Please hang tight! We will follow up on the thread you created yesterday :slight_smile:

Hey @fool, would you mind adding a couple bots from Ahrefs to the prerender list? Thank you for your time. Bot info.

  • Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/)
  • Mozilla/5.0 (compatible; AhrefsSiteAudit/6.1; +http://ahrefs.com/robot/)

Hi @patrickstox,

I’d advise you to watch this thread:

We’d post an update there as soon as this works out.

1 Like

I have no way of confirming this, but due to a massive increase in bandwidth usage I believe prerendering is counted against bandwidth usage. Can you please check and confirm if this is intentional or a bug.

Hi, @CaffeDoppio. The email address you used for this forum isn’t associated with any sites at Netlify. In order to research this, we will need to know which site you are asking about.

You can post that information publicly or you can private message (PM) that to one of our support staff. I’ve confirmed that PMs are enabled for your forum login. Please keep in mind that only one person can see the PM and this will likely mean a slower reply than posting the information publicly. Please feel free to reply to however you prefer though.

Hi @luke thanks for your reply and for looking into this. It’s ccgtrader.net.

I have prerendering working with Twitter / Facebook, but for some reason it doesnt seem to work with opengraph.xyz can anyone point me in the right direction?

The website I am testing is https://sharehomethegame.com/characters

You can use any of the characters under this page to test different URLs.

Is that some service? If so, it might have a customer pre-render agent that we might not have configured on our end. If you can find its user agent and let us know, we can investigate if it can be added.

Hi, we will like to deactivate the External Prerender for our site prod-drinks-consumer-marketplace.netlify.app and switch to the internal pretender service by Netlify?

Hey @Spazwik,

This has been updated.

Thank you, will test it out to see if it works properly.

Hi all, really interested in using this for a website that needs to be SEO friendly and have some questions.

  1. This has been in Beta for awhile. Is it expected to be supported long term, or is there any hint that it might get dropped in the future?
  2. Docs say it may not be available on all plans. Are there differences in plans?
  3. How does Netlify crawl my site to know what routes to prerender?

Hi @Cam8433,

  1. While the feature is in Beta, there are no plans to drop support any time soon.

  2. Configuring external pre-redendering is something that’s not available on the starter plan, but Netlify built-in pre-rendering is available for all plans.

  3. Netlify will not pre-render your site unless someone requests a page. And by someone, I mean a pre-render agent. Once Googlebot for example requests a page of your website, Netlify will pre-render it and store it in a cache.

1 Like