I have the same problem. My version of EOG is 3.10.2-0ubuntu2~saucy1 / Gnome Ubuntu 13.10 and I am attaching screenshot what I get for the Marius' sample image. For many other images I can see somthing very similar to Marius' bug report and it seems it is somehow screwed image of desktop - part where eog application window is placed.
I have the same problem. My version of EOG is 3.10.2- 0ubuntu2~ saucy1 / Gnome Ubuntu 13.10 and I am attaching screenshot what I get for the Marius' sample image. For many other images I can see somthing very similar to Marius' bug report and it seems it is somehow screwed image of desktop - part where eog application window is placed.