What you describe is correct behaviour (with default settings). You want this:
File → Configure → Preferences ⇒ gui.fullscreen_mode.always_sticky
What you describe is correct behaviour (with default settings). You want this:
File → Configure → Preferences ⇒ gui.fullscreen_ mode.always_ sticky