AI OSS Hub

A lightweight, secure, and high-performance microVM platform designed for serverless and multi-tenant workloads.

A framework for building LLM-powered applications with composable components and rich integrations.

Local large language model runner that enables users to easily run and manage various open-source LLM models in local environments.

An open-source RAG engine based on deep document understanding, supporting complex document parsing and knowledge Q&A

High-performance open-source framework for LLM and VLM inference, supporting multimodal, extreme concurrency, and flexible frontend programming.

High-throughput, memory-efficient inference and serving engine for large language models.