I went back to ALARM again and did some testing with dwm, and after fbturbo is installed the performance is equal to raspbian. So I'll mark this thread as solved. Even though I still haven't achieved full graphics acceleration, but that'll probably change in the future with the VC4 driver.
To recap: the xf86-video-fbturbo-git package should be installed by default in the alarm/rpi image.