What is the inference engine used by NVIDIA DeepSeek R1 FP4?
Question
Lost your password? Please enter your email address. You will receive a link and will create a new password via email.
Lorem ipsum dolor sit amet, consectetur adipiscing elit.Morbi adipiscing gravdio, sit amet suscipit risus ultrices eu.Fusce viverra neque at purus laoreet consequa.Vivamus vulputate posuere nisl quis consequat.
Answers ( 1 )
NVIDIA DeepSeek R1 FP4 uses the TensorRT-LLM inference engine, which is tested on NVIDIA B200 hardware.