That's the ironic thing, Google Video did provide a direct download link... sorta, at one point they modified VLC and called it "Google Video Player" or something, users downloaded "GVI" files which were text wrappers to a direct XViD encoded file.
That's unfortunately not the case anymore.