<Alt>F4 not working on Compiz start

I imported my Compiz setting from another system (Debian 11 KDE -> Debian 12 KDE)
ccsm > Preferences > Import

In ccsm it shows 'Close Window' is set to '<Alt>F4'
ccsm > General > General Options > Key bindings > Close Window > <Alt>F4

If I delete this '<Alt>F4',
Click on it's 'Edit Close Window', press backspace to delete highlighted text, then click 'OK'.

and put '<Alt>F4' back,
Click on it's 'Edit Close Window' again, and type in '<Alt>F4', then click 'OK'

Then the 'Close Window' shortcut will work.
However, When Compiz gets started back up again, the shortcut is still showing as there, but no longer working, and I have to do the above steps again to get it back working.

Is there a way to to get this shortcut to work, and stay working between Compiz sessions?
P.S. Are there any other shortcuts, etc... that are affected by this?