Colemak keyboard layout's left-hand backspace is also acting as Caps Lock

I have installed Ubuntu with the default English (US) Qwerty keyboard layout and I added the English (Australia) Colemak keyboard layout through the Settings app (as per the screenshot attached). This is for the in-built laptop keyboard on the Lenovo ThinkPad X1 Yoga Touch.

The bug is that the CapsLock key, which is meant to be remapped to a Backspace key on the Colemak keyboard layout, acts as both the CapsLock AND the Backspace, when the Colemak keyboard layout is active. This means that backspacing a single time deletes a single character AND also toggles Caps Lock.

The expected behaviour is that the key acts only as Backspace when the Colemak keyboard layout is active.

The output of 𝚡𝚙𝚛𝚘𝚙 -𝚛𝚘𝚘𝚝 | 𝚐𝚛𝚎𝚙 𝚇𝙺𝙱 is

 _𝚇𝙺𝙱_𝚁𝚄𝙻𝙴𝚂_𝙽𝙰𝙼𝙴𝚂(𝚂𝚃𝚁𝙸𝙽𝙶) = "𝚎𝚟𝚍𝚎𝚟", "𝚙𝚌𝟷𝟶𝟻", "𝚞𝚜,𝚞𝚜,𝚞𝚜", ",𝚌𝚘𝚕𝚎𝚖𝚊𝚔,", ""

I hope a fix can be found soon :)

ProblemType: Bug
DistroRelease: Ubuntu 20.04
Package: xorg 1:7.7+19ubuntu14
ProcVersionSignature: Ubuntu 5.11.0-38.42~20.04.1-generic 5.11.22
Uname: Linux 5.11.0-38-generic x86_64
ApportVersion: 2.20.11-0ubuntu27.20
Architecture: amd64
BootLog: Error: [Errno 13] Permission denied: '/var/log/boot.log'
CasperMD5CheckResult: skip
CompizPlugins: No value set for `/apps/compiz-1/general/screen0/options/active_plugins'
CompositorRunning: None
CurrentDesktop: ubuntu:GNOME
Date: Tue Oct 19 17:34:44 2021
DistUpgraded: Fresh install
DistroCodename: focal
DistroVariant: ubuntu
ExtraDebuggingInterest: Yes, if not too technical
GraphicsCard:
 Intel Corporation HD Graphics 620 [8086:5916] (rev 02) (prog-if 00 [VGA controller])
   Subsystem: Lenovo HD Graphics 620 [17aa:224e]
InstallationDate: Installed on 2021-10-09 (9 days ago)
InstallationMedia: Ubuntu 20.04.3 LTS "Focal Fossa" - Release amd64 (20210819)
MachineType: LENOVO 20JDA00CAU
ProcKernelCmdLine: BOOT_IMAGE=/vmlinuz-5.11.0-38-generic root=/dev/mapper/vgubuntu-root ro quiet splash vt.handoff=7
SourcePackage: xorg
Symptom: display
UpgradeStatus: No upgrade log present (probably fresh install)
dmi.bios.date: 08/17/2021
dmi.bios.release: 1.41
dmi.bios.vendor: LENOVO
dmi.bios.version: N1NET54W (1.41 )
dmi.board.asset.tag: Not Available
dmi.board.name: 20JDA00CAU
dmi.board.vendor: LENOVO
dmi.board.version: SDK0K17763 WIN
dmi.chassis.asset.tag: No Asset Information
dmi.chassis.type: 31
dmi.chassis.vendor: LENOVO
dmi.chassis.version: None
dmi.ec.firmware.release: 1.19
dmi.modalias: dmi:bvnLENOVO:bvrN1NET54W(1.41):bd08/17/2021:br1.41:efr1.19:svnLENOVO:pn20JDA00CAU:pvrThinkPadX1Yoga2nd:skuLENOVO_MT_20JD_BU_Think_FM_ThinkPad:rvnLENOVO:rn20JDA00CAU:rvrSDK0K17763WIN:cvnLENOVO:ct31:cvrNone:
dmi.product.family: ThinkPad
dmi.product.name: 20JDA00CAU
dmi.product.sku: LENOVO_MT_20JD_BU_Think_FM_ThinkPad
dmi.product.version: ThinkPad X1 Yoga 2nd
dmi.sys.vendor: LENOVO
version.compiz: compiz N/A
version.libdrm2: libdrm2 2.4.105-3~20.04.2
version.libgl1-mesa-dri: libgl1-mesa-dri 21.0.3-0ubuntu0.3~20.04.3
version.libgl1-mesa-glx: libgl1-mesa-glx N/A
version.xserver-xorg-core: xserver-xorg-core 2:1.20.11-1ubuntu1~20.04.2
version.xserver-xorg-input-evdev: xserver-xorg-input-evdev N/A
version.xserver-xorg-video-ati: xserver-xorg-video-ati 1:19.1.0-1
version.xserver-xorg-video-intel: xserver-xorg-video-intel 2:2.99.917+git20200226-1
version.xserver-xorg-video-nouveau: xserver-xorg-video-nouveau 1:1.0.16-1