The Deep Learning Lab has been established in the CREDIT Center at Prairie View A&M University since 2017. The Deep Learning Lab features four NVIDIA DGX-1 Deep Learning systems totaling 32 Tesla P100 GPUs with 114,688 CUDA cores, 2,752 GB memory, and 244 TB HDD. Each DGX-1 system has eight Tesla P100 GPU accelerators connected through NVLink, the NVIDIA high-performance GPU interconnect, in a hybrid cube-mesh network. Together with dual socket Intel Xeon CPUs and four 100 Gb InfiniBand network interface cards, DGX-1 provides unprecedented performance for deep learning training. Moreover, the DGX-1 system software and powerful libraries are tuned for scaling deep learning on its network of Tesla P100 GPUs to provide a flexible and scalable platform for deep learning. In addition, the Deep Learning Lab also contains one Dell R920 server for user and resource management, and four Dell R730 storage servers to maintain large datasets.