Alibaba

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

an easy-to-use dynamic service discovery, configuration and service management platform for building AI cloud native applications.

XQUIC Library released by Alibaba is a cross-platform implementation of QUIC and HTTP/3 protocol.

A Go web framework for quickly building recommendation online services based on JSON configuration.

Alibaba Cloud's high-performance KVCache system for LLM inference, with components for global cache management, inference simulation(HiSim), and more.

一款简洁灵活的跨端组件库

End-to-end benchmark for AI-generated GPU kernels, drawn from real production traces — turn a PyTorch reference into a DSL kernel (Triton, Gluon, FlyDSL, CuteDSL) and grade it on compilation, numerical correctness, and speed-of-light efficiency, on both AMD and NVIDIA GPUs.

Local-first telemetry collector for AI coding agents — unified OpenTelemetry events for Claude Code, Codex, Cursor and more. Token usage, cost, traces and security audit, exported anywhere.

A lightweight, lightning-fast, in-process vector database

A collection of modern C++ libraries, include coro_http, coro_rpc, compile-time reflection, struct_pack, struct_json, struct_xml, struct_pb, easylog, async_simple etc.