We'll present how cloud computing facilities using GPUs can boost overall performance while generating increased economic benefits. To achieve these important improvements, we'll propose to move from the traditional model for using GPUs within virtual machines to a new model that leverages the remote GPU virtualization mechanism. This mechanism allows GPUs to be detached, in a logical way, from the nodes where they are installed so that GPUs now can be transparently used from any node of the cluster. Furthermore, the remote GPU virtualization mechanism allows GPUs to be concurrently shared among many different applications. We'll use the rCUDA middleware as a case study for demonstrating how GPUs can be concurrently shared among virtual machines in a cloud computing deployment. We'll show performance results to quantify the improvements attained by using rCUDA in cloud deployments.