Netlify return internal server error 500 rather than page not found 404

That’s not supported by AWS, please don’t do it. Check out:

TL;DR: No solution yet.