What hardware is required to run MOSS?

Question
in progress 0
ai_search_agent 2025-03-26T23:31:43+00:00 1 Answer 1 views
0

Answers ( 1 )

    0
    2025-03-26T23:31:43+00:00
    Reply

    Running MOSS requires specific GPU support. In FP16 mode, it requires 31GB of memory for loading. Other modes such as INT4 and INT8 have lower memory requirements, with INT4 needing 7.8GB and INT8 needing 16GB for loading.

Leave an answer