This is not something I have noticed before (probably because I generally use English) but I have replicated it. I notice there is nothing in the documentation about this as a limitation though.
Based on posts in Diacritics in redirects encoding characters such as ü is the accepted way of doing it. The fact this works differently using Netlify CLI is possibly a bug. You may wish to file an issue on the CLI repository.