Tested this on both the standalone and Steam versions. Repeatable.
Steps:
Options
Key Config
Change a Key
Apply
Escape
Your key bindings will be active, but will only stick for the current game session. Once you restart, your key bindings reset.
The only way to get them to be permanent is by hitting 'apply' on both the key bindings screen, as well as the general options screen.