Keyboard layout is forgotten if I remove the keyboard indicator

My keyboard layout gets swtiched back to US after a reboot if I hide the indicator from the panel (no uninstalling).
It does not matter that I switch it back using setxkbmap.
The input settings displays the keyboard as set in the correct layout but It is not, really.

ProblemType: Bug
DistroRelease: Ubuntu 13.10
Package: indicator-keyboard 0.0.0+13.10.20131010.1-0ubuntu1
ProcVersionSignature: Ubuntu 3.11.0-13.20-generic 3.11.6
Uname: Linux 3.11.0-13-generic x86_64
NonfreeKernelModules: wl
ApportVersion: 2.12.5-0ubuntu2.1
Architecture: amd64
Date: Thu Nov 14 21:33:35 2013
InstallationDate: Installed on 2012-11-25 (354 days ago)
InstallationMedia: Ubuntu 12.10 "Quantal Quetzal" - Release amd64 (20121017.5)
MarkForUpload: True
SourcePackage: indicator-keyboard
UpgradeStatus: Upgraded to saucy on 2013-10-18 (27 days ago)