NVIDIA’s H100 GPU is now twice as fast in LLM inferencing thanks to latest software update
Calvin Liew September 12, 2023
NVIDIA has announced the latest TensorRT-LLM software that managed to push its top-of-the-line H100 cards achieving doubled output.
