Latch
A compiler that turns a PyTorch training step into one GPU program.
Latch compiles supported PyTorch training code into a single program for the forward pass, loss, backward pass and optimizer update. It is an MIT-licensed research preview for NVIDIA H100 GPUs.