@Milo What is the href= value that you have that links to the page within your source code?
If you define the link as href="/contact" then it will appear as /contact.
If you define it as href="/contact.html" then it will appear as /contact.html.