AIOS: AI Agent Operating System - An innovative platform integrating large language models (LLMs) into operating systems for efficient AI agent development.

## Core Concept of AIOS The core concept of AIOS is to deeply integrate large language models (LLMs) into operating systems. This integration optimizes resource management, context switching, and tool services, transforming traditional OS interactions and task execution methods. The goal is to create a more intelligent, efficient, and flexible operating system environment for AI agent development. ## Key Features of AIOS AIOS offers several key features: - **Support for multiple agent frameworks**: Includes ReAct, Reflexion, OpenAGI, AutoGen, Open Interpreter, and MetaGPT. - **Function calling for open-source LLMs**: Supports HuggingFace, vLLM, Ollama, and others. - **External tool integration**: Enables the use of tools like Google Search, WolframAlpha, and Rapid API. - **Local model support**: Includes HuggingFace diffusion models and Deepseek-r1 models (ranging from 1.5b to 671b parameters). - **Flexible deployment modes**: Offers local kernel (Mode 1), remote kernel (Mode 2), and hybrid modes (Mode 2.5, 3, and 4 under development). ## Key Features of AIOS AIOS provides the following functionalities: - **Resource management**: The AIOS Kernel manages resources such as LLMs, memory, storage, and tools. - **Agent development and deployment**: The AIOS SDK (Cerebrum) facilitates agent development, deployment, and discovery. - **Interaction methods**: Supports Web UI and Terminal UI for interacting with agents, leveraging a semantic file system (AIOS-LSFS). - **Configuration options**: Allows configuration via `config.yaml` or interactive commands like `aios env list` and `aios env set`. - **Broad LLM support**: Integrates models from providers like OpenAI (GPT-4, 4 Turbo), Anthropic (Claude 3.5), Google (Gemini), and open-source options (HuggingFace, Ollama). ## Installation and Usage of AIOS Developers can install and use AIOS as follows: 1. **Installation**: - Requires Python 3.10-3.11. - Clone the [AIOS GitHub repository](https://github.com/agiresearch/AIOS) and set up a virtual environment. - Install dependencies using `requirements-cuda.txt` (for GPU) or `requirements.txt` (for CPU). 2. **SDK Setup**: - Install the AIOS SDK (Cerebrum) by cloning its [repository](https://github.com/agiresearch/Cerebrum) and running `pip install -e .`. 3. **Configuration**: - Set API keys (e.g., `OPENAI_API_KEY`, `GEMINI_API_KEY`) in `aios/config/config.yaml` or via interactive commands. 4. **Launch**: - Start the kernel using `runtime/launch_kernel.sh` or `python3.x -m uvicorn runtime.kernel:app --host 0.0.0.0 --port 8000`. 5. **Interaction**: - Use the terminal script `python scripts/run_terminal.py` or access the Web UI. Documentation and community support are available via the [AIOS Documentation](https://docs.aios.foundation/) and [Discord](https://discord.gg/B2HFxEgTJX). ## Supported LLM Providers and Models AIOS supports a wide range of LLM providers and models, including: - **Anthropic**: Claude 3.5 Sonnet, Haiku, Opus (API key: `ANTHROPIC_API_KEY`). - **Deepseek**: deepseek-reasoner, deepseek-chat (API key: `DEEPSEEK_API_KEY`). - **Google**: Gemini 1.5 Flash, Pro (API key: `GEMINI_API_KEY`). - **OpenAI**: GPT-4, 4 Turbo, 4o (API key: `OPENAI_API_KEY`). - **Groq**: Llama 3.2 90B Vision, 3.1 70B (API key: `GROQ_API_KEY`). - **HuggingFace**: All models (backend: `huggingface`, env: `HF_HOME`). - **Ollama/vLLM**: All models (no API key required). ## Latest Version of AIOS The latest version of AIOS is **v0.2.2**, released on **2025-03-12**. This version includes significant architectural refactoring and updates to improve functionality and performance. ## AIOS Documentation and Community Developers can access the following resources: - **Official Documentation**: [AIOS Documentation](https://docs.aios.foundation/). - **GitHub Repository**: [AIOS GitHub](https://github.com/agiresearch/AIOS). - **Community Support**: Join the [AIOS Discord](https://discord.gg/B2HFxEgTJX) for discussions and assistance. - **Contribution Guidelines**: Refer to [CONTRIBUTE.md](https://github.com/agiresearch/AIOS/blob/main/docs/CONTRIBUTE.md) for contributing to the project. ### Citation sources: - [AIOS: AI Agent Operating System](https://github.com/agiresearch/AIOS) - Official URL Updated: 2025-04-01