first, make sure you have latest drivers for your video adapter
if you still have this "switching to RGB" error, check "force RGB mode" in preferences->video
I think it will prevent the popup message to appear
if you still have an upside-down picture, you may have a look here:
http://forum.bsplayer.org/viewtopic.php?t=702