OK, current status:
rootfs is on SSD, works without any problems. Bootloader is still on sdcard though, doesn't bother so far.
wifi: nothing new, not tested.
hardware acceleration + xbmc: well, Xorg was running, with software rendering. So it was reeeaaaally slow. After some issues I managed to compile relllas xbmca10 following more or less this guide:
http://linux-sunxi.org/XBMCSince they use apt to install the deps, it took me some time to get the make + make install finishing without errors.
When I try to start this xbmc version, I get a EGL error. So there are still issues with the graphics driver + kernel or whatever combination.
I'll backup my current status now and move on trying to get gentoo to work. There is a nice overlay with quite some software, I'll see if their drivers works better. I actually don't fully understand all the driver issues, what parts are closed source, what status the lima drivers for mali400 has etc. pp.
To be continued ^^