"Invalid AWS Lambda parameters. Reserved keys used in this request."

Does the 4kb limit apply to just environment variable VALUES or to the combinations of KEY/VALUE pairs?

What I mean is, if we use short environment variables names are we saving some characters that we can then use towards the 4kb limit?

Yes, the name counts too. So you can squeeze in a few characters by keeping shorter names.