MOSS - An open-source bilingual conversational language model developed by Fudan University.

## Overview of MOSS MOSS is an open-source conversational language model developed by Fudan University. It supports both Chinese and English, and is designed with 1.6 billion parameters. The model is trained on approximately 700 billion words of Chinese, English, and code data, and features multi-turn dialogue capabilities, plugin integration, and alignment with human preferences for helpfulness, harmlessness, and honesty. ## Developer of MOSS MOSS was developed by Fudan University's Natural Language Processing Laboratory. ## Language Support in MOSS MOSS supports both Chinese and English, making it a bilingual conversational language model. ## Parameter Count of MOSS MOSS has 1.6 billion parameters. Although some sources initially mentioned 16 billion, this was likely a typographical error, and the official count is 1.6 billion. ## Training Data Size of MOSS MOSS is trained on approximately 700 billion words of Chinese, English, and code data. Earlier mentions of "seven trillion" words were likely a typographical error. ## Key Features of MOSS The key features of MOSS include bilingual support (Chinese and English), plugin integration for enhanced functionality, multi-turn dialogue capabilities, and alignment with human preferences for helpfulness, harmlessness, and honesty. ## Accessing MOSS MOSS is available on GitHub and Hugging Face. The GitHub page provides access to the code and models, while Hugging Face offers downloadable models and datasets. ## Hardware Requirements for MOSS Running MOSS requires specific GPU support. In FP16 mode, it requires 31GB of memory for loading. Other modes such as INT4 and INT8 have lower memory requirements, with INT4 needing 7.8GB and INT8 needing 16GB for loading. ## Purpose of MOSS The purpose of MOSS is to provide a powerful AI conversational tool that supports bilingual interaction, integrates plugins for enhanced functionality, and aligns with human preferences for helpfulness, harmlessness, and honesty. ## Significance of MOSS's Name The name MOSS may be inspired by the character MOSS from the science fiction work "The Wandering Earth," similar to HAL 9000 from "2001: A Space Odyssey," reflecting its design inspiration. ### Citation sources: - [MOSS](https://github.com/openmoss/moss) - Official URL Updated: 2025-03-26