I've just installed Arch on my Pandaboard in order to use it as an media center based on XBMC. I've never succeeded this with a recent version of ubuntu.
The information about the graphics support I found are all very old, like this: viewtopic.php?f=48&t=1595
I wonder if there is any progress in the sgx450 driver? Are there any others SoCs with this chips?