Today Deep Learning achieved stunning results in visual recognition as such to raise the question of whether this problem is actually solved. Should this be the case, the advantages for robotics could be dramatic. Indeed, the lack of reliable visual skills is a major bottle neck for robots deployment in everyday life. With this respect in mind, we started an effort to quantify the benefits and limits, if any, of DL in the context of robot vision. By exploiting R1, our latest humanoid equipped with an NVIDIA Jetson TX1 , we investigated key differences between robot vision and other applications where DL typically excels, as image retrieval. Our study identified critical issues to be tackled via computer vision and machine learning, while taking advantage of a robot platform. Our results confirm the huge impact of DL, testified by the great real-time recognition capabilities of R1, while pointing at specific open challenges that need to be addressed for seamless deployment in robotics.