It does only stay active if it's playing, if you stop the song first and close it then it exits, you can also exit while playing using the file->exit menu entry
It does only stay active if it's playing, if you stop the song first and close it then it exits, you can also exit while playing using the file->exit menu entry