PyTorch

Everything you need for RL neural networks: layers, optimizers, batching, GPU training, and practical examples tailored for value-based and policy-based methods.