I build AI infrastructure on Kubernetes — currently working on multi-billion-scale image vector retrieval (Milvus / FAISS) and AI platform (training & inference) at Megvii.
What I work on
- ☸️ Kubernetes internals: operators, GPU scheduling (HAMi / Volcano / Kueue / Device Plugin)
- 🔍 Vector search at scale: index selection, recall/latency/memory benchmarking, capacity planning
- 🖥️ GPU infrastructure: NCCL tuning, DCU/NPU enablement, container-level GPU management — earlier built a multi-tenant GPU cloud (A100/H800, per-second billing) serving external users
- 🏗️ Multi-tenant K8s clusters (VCluster) — previously at DataCanvas
- 📊 Measuring before believing — most of my work starts with a benchmark
Upstream contributions kubernetes/kubernetes · golang/go · apple/containerization · vcluster · aibrix · HAMi · kueue · all PRs →
Writing: Zhihu column (Chinese)



