What is the inference engine used by NVIDIA DeepSeek R1 FP4?

Question

Answers ( 1 )

    0
    2025-03-28T03:40:17+00:00

    NVIDIA DeepSeek R1 FP4 uses the TensorRT-LLM inference engine, which is tested on NVIDIA B200 hardware.

Leave an answer