Thanks @talves - that works.
But I can also confirm that the solution I used before your suggestion, which was provided in this thread, actually does work too!
I realized the reason for my error was not including _redirects in the published build directory as suggested in the docs 
I was tipped off to this by the fact that each deploy summary mentioned that there were no redirect rules processed during the deploy.