Nowadays, there's no difference between the Ubuntu Desktop and server except for the default installed packages. There used to be a ubuntu-server kernel a few years back. As Zoltan said, you can install Ubuntu server and then install a DE of your choice. However, I can't see any real benefit if you install Ubuntu server and then a DE. Once you install the DE you will have that whole desktop as if you were installing the standard Ubuntu, Xubunt, Kubuntu or Lubuntu. The fastest of all would be Lubuntu. If you've installed the server version already, you can just do "sudo apt-get install ${DE}-desktop" (replace ${DE} with the DE of your choice xubuntu, ubuntu, kubuntu or lubuntu).