Resource entry to the runtime stack

AI OSS Hub

Curated open-source projects around Agentic Runtime, AI Native Infra, and the surrounding ecosystem.

Featured Projects

Secure open source cloud runtime for AI apps & AI agents.

A framework for building LLM-powered applications with composable components and rich integrations.

Local large language model runner that enables users to easily run and manage various open-source LLM models in local environments.

An open-source RAG engine based on deep document understanding, supporting complex document parsing and knowledge Q&A

High-performance open-source framework for LLM and VLM inference, supporting multimodal, extreme concurrency, and flexible frontend programming.

High-throughput, memory-efficient inference and serving engine for large language models.

Execution and workflow engines for agents as processes. Contracts, state, and orchestration around the runtime.

Inference engines, GPU optimization, serving gateways, and distributed compute that power the runtime layer.

Retrievers, vector stores, rerankers, and pipelines that feed context into agent workflows.

Select your use case, and AI will automatically build a complete tech stack with architecture diagram.

Coming Soon

View detailed metrics, ratings, and community insights for each project to make informed decisions.

Coming Soon

Have a project to add?