ultrafeedback

Here are 3 public repositories matching this topic...

saitejasrivilli / preference-data-pipeline

RLHF preference data curation pipeline: HH-RLHF + UltraFeedback + OASST1 → quality filter → MinHash dedup → DPO-ready JSONL

python minhash data-curation post-training dpo llm rlhf preference-data hh-rlhf ultrafeedback

Updated Jun 7, 2026
Python

utkarshdudeja830 / reinforcement-learning-rlhf-alignment

Star

Reinforcement learning from human feedback (RLHF) fine-tuning of Qwen2.5-0.5B-Instruct with LoRA and Hugging Face TRL on the UltraFeedback preference dataset. Runs on a free Colab T4.

reinforcement-learning transformers pytorch alignment lora pef fine-tuning preference-learning google-colab huggingface trl llm rlhf qwen ultrafeedback

Updated Oct 18, 2026
Jupyter Notebook

wlixwlix / rlhf-rlvr-analyzer

Star

Measuring verbosity bias in UltraFeedback (61K GPT-4-annotated preference pairs): statistically unambiguous, but a small effect. Python + Streamlit.

python data-quality streamlit rlhf rlaif preference-data llm-alignment ultrafeedback

Updated Aug 11, 2026
Python

Add this topic to your repo

To associate your repository with the ultrafeedback topic, visit your repo's landing page and select "manage topics."

Learn more