Okay, I played a little around with window managers. Mutter also has graphical glitches (a little different ones though), Compiz doesn't work at all, Xfce and Fluxbox work and If I replace elementary's window manager gala with xfwm4 then as far as I can see the severe glitches disappear with only minor glitches remaining.