You can try this: Cached version of website not updating on new build/repo change - #6 by hrishikesh
Not sure how you can integrate it with the plugin though. Maybe, you can remove the plugin, add a custom service worker and add that code to your gatsby-browser.js.