I use my Pi in headless mode, and I like to use X over SSH occasionally to run graphics only apps like the Pi store, and a few of my programs. I'd like to increase my RAM by decreasing GPU RAM, in accordance to the answer of this question.
For example, this is how I would start the session:
ssh -X pi@[IP ADDRESS]. I can then run
startxfce4 and it'll start the GUI in X11 on my Mac, resulting in a VNC-style connection.
In doing so, I'm running the X server on my Mac, so does that mean that no video RAM is being used on the RPi because my Mac is the one handling the Graphics?