Technical documentation for key features and systems is contained in the following pages
- Build Instructions: Instructions to build and run the project on a headset.
- Meta SDK: List of key Meta features used in the project.
- Face Blurring: Description of face detection and blurring for privacy protection, RetinaFace model details, Quest CPU backend optimization.
- Image Object Recognition: Description of: Object Recognition and the Unity Inference Engine, overview of the specific YOLO implementation used, sample scene details.
- Meta Model API: Overview of Meta Model API, choosing a model, use case examples of text chat and image understanding, discussion of C# implementation, sample scene details.
- MRUK: Discussion of Mixed Reality Utility Kit (MRUK), sample scene details.
- Occlusion: Overview of Meta's occlusion package, example code.
- PCA: Overview of Passthrough Camera API (PCA), code examples of: camera world orientation, camera image screenspace, and depth estimation. Sample scene details.
- State Machine: Overview of Unity Visual Scripting, discussion of State Machine used in project, coding examples.
- Voice Synthesis: Overview of Voice Synthesis provided by VoiceSDK and wit.ai, C# classes description.
- Voice Transcription: Overview of Voice Transcription provided by VoiceSDK and wit.ai, C# classes description.