Comment 9 for bug 34058

Matt - set the port you wish to use, apply your settings, restart Evolution, and things will work fine.

The bug is that custom port settings don't take effect until a restart.