Right, you probably want vnc over ssh. I'm not sure it's possible to forward a DE over X (and if it is possible, you don't want to -- it'll be very slow).
An even better solution: don't run a DE over ssh at all.
Utilize the command line instead, and when you need an X application, launch just that application.