mutlimodal

Stream-Omni is a GPT-4o-like language-vision-speech chatbot that simultaneously supports interaction across various modality combinations.

Probing the limitations of multimodal language models for chemistry and materials research

Hierarchical, multilingual, multimodal detection of persuasion techniques in memes (SemEval‑2024 Task 4), with a custom hierarchical loss and strong H‑F1 across 4 languages.

multimodal projects (mostly testing stuff)

🌿 MindEase - A gamified AI journaling companion that transforms mental wellness into an engaging daily habit using Google Gemini AI, mood analysis, breathing exercises, streaks, and a virtual companion system.

High-performance Rust inference engine for LightOnOCR-2-1B using ONNX Runtime.