Issues

• Exceptions thrown from the extension report an empty file and line 0

  future
  DisplaceTech/ext-infer#14 · Filter by author ericmann opened on Oct 29, 2026

• x86_64 prompt-processing throughput

  future
  DisplaceTech/ext-infer#13 · Filter by author ericmann opened on Oct 29, 2026

• ZTS: parallel\Runtime stress test

  future
  DisplaceTech/ext-infer#12 · Filter by author ericmann opened on Oct 29, 2026

• Tokenizer utilities (HF tokenizers)

  future
  DisplaceTech/ext-infer#11 · Filter by author ericmann opened on Oct 29, 2026

• Continuous batching for worker processes

  future
  DisplaceTech/ext-infer#10 · Filter by author ericmann opened on Oct 29, 2026

• Apple Metal by default on macOS arm64

  future
  DisplaceTech/ext-infer#9 · Filter by author ericmann opened on Oct 29, 2026

• Tool calling

  future
  DisplaceTech/ext-infer#8 · Filter by author ericmann opened on Oct 29, 2026

• Multimodal (mmproj) input

  future
  DisplaceTech/ext-infer#7 · Filter by author ericmann opened on Oct 29, 2026

• LoRA adapters

  future
  DisplaceTech/ext-infer#6 · Filter by author ericmann opened on Oct 29, 2026

• Stop-string support

  future
  DisplaceTech/ext-infer#5 · Filter by author ericmann opened on Oct 29, 2026

• Session / KV-cache reuse

  future
  DisplaceTech/ext-infer#4 · Filter by author ericmann opened on Oct 29, 2026

• Streaming completions

  future
  DisplaceTech/ext-infer#3 · Filter by author ericmann opened on Oct 29, 2026

• Render chat templates with Jinja (models llama.cpp's built-in matcher doesn't recognise)

  future
  DisplaceTech/ext-infer#2 · Filter by author ericmann opened on Oct 29, 2026