FIM Evaluation Framework

[mcelrath]

This issue is to track the progress and effectiveness of Fill-In-Middle completion engines.

• Provide RAG data ChatBTC RAG data #3 to the FIM engine
• Ingest codebases into the RAG engine
• Experimentation
• Evaluate performance

Resources:

• https://github.com/gonglinyuan/safim