Guest
nVidia TensorRT Extension is an official extension for Stable Diffusion WebUI which allows you to use the Tensor Cores in your nVidia GPU for image generation performance boost. During my testing on an RTX 4090, I observed somewhere from 20% to 50% performance improvement when using TensorRT. However, it does have its limitations and bugs. In this tutorial, I cover everything from how it works, to installing it, removing launching errors, and explaining the exact settings for the training of the TensorRT Engine Profile. ------------------------ Relevant Links: Onnx and RT FIles (YouTube Membership): @controlaltai/join A1111 GitHub: nVidia TensorRT Extension: Checkpoints SDXL: Hugging Face SDXL Base: SDXL VAE:
