There is a mode, called shadow framebuffer, where the graphics is only used to display the images. All rendering is done in memory in a so-called shadow framebuffer. This mode is useful if you need lots of reading in the video memory. You will have to put
Option "ShadowFB"
in your XF86Config file.