Overview
Build and support Transformer Engine, the open-source library for accelerating the training of Large Language Models. Collaborate on systems research that improves Deep Learning model performance, such as training using extremely low precision, parallelism methods, etc. Implement, benchmark, and optimize new Deep Learning models such as LLMs straight out of groundbreaking research to scale efficiently on NVIDIA GPUs and systems.