Pinned Loading

1. Agentic-Kernel-Generation Agentic-Kernel-Generation Public

   LLM agents that generate, verify, and evolve Triton GPU kernels. Includes a reward-hack-resistant benchmarking harness with strict correctness verification and fresh-input evaluation. Achieves up t…

   Python

2. Parallel-Eagle Parallel-Eagle Public

   A lossless speculative decoder: a parallel multi-token drafter + dynamic tree verification.

   Python

3. DiSpec DiSpec Public

   DiSpec — a from-scratch LLM inference engine: paged attention, continuous batching, CUDA-graph decode, speculative decoding, and prefill/decode disaggregation

   Python

4. Schema-Linking-with-SFT Schema-Linking-with-SFT Public

   LoRA fine-tuned Qwen2.5-Coder-1.5B for schema linking in NL-to-SQL: given a question and a database schema, predicts the referenced tables and columns as JSON. Uses self-consistency decoding (k=10)…

   Python

5. rag-context-engineering rag-context-engineering Public

   Retrieval-augmented generation for documentation QA under a 2,000-token context budget — multi-resolution chunking, hybrid BM25+FAISS retrieval, cross-encoder reranking, and grounded generation, w…

   Python

6. search-hotstar search-hotstar Public

   Semantic search engine over a streaming catalog — scrapes, enriches, embeds, and indexes titles into Qdrant, then serves vector + lexical hybrid search via FastAPI with a lightweight frontend.

   Python