MetaClase

MetaClase is a cross-platform multiplayer learning game for education and corporate training, enabling interactive lessons, activities, and virtual learning environments. At OLSDATA, I lead Unity development across networking, gameplay systems, educational authoring tools, cloud integration, and AI-powered interactions.

🧠 Technical Contributions

🛠️ What I Built

Cross-Platform Multiplayer Architecture: Designed and implemented multiplayer systems using Photon Fusion 2.1, including synchronized player states, room management, coordinated scene transitions, shared educational activities, and support for users joining ongoing sessions.
In-Game Educational Editors: Developed and extended runtime authoring tools that enable teachers to create, customize, and organize lessons, exercises, dialogues, minigames, and interactive educational experiences directly within MetaClase, without requiring programming knowledge.
Character Customization: Implemented character customization systems for teachers, students, and NPCs, allowing users to personalize their avatars and educators to create and configure characters for their own educational activities.
NPC Behaviors & Dynamic Navigation: Developed NPC interaction systems, autonomous behaviors, and runtime navigation solutions, including dynamic NavMesh adaptation for modular environments created and modified during gameplay.
Cloud Content & Data Systems: Architected cloud-backed workflows using Amazon S3 and Photon Fusion, supporting remote content delivery, saved user data, and synchronization of relevant gameplay information across multiplayer sessions.
AI & Speech Technologies: Integrated OpenAI API and Azure Cognitive Services for AI-driven interactions, text-to-speech, and speech and language recognition. Combined synthesized speech with SALSA LipSync for synchronized character dialogue animations.
Interactive Gameplay & Content Systems: Developed reusable systems for dynamic dialogue, quest-like activity flows, contextual interactions, and interactive minigames supporting different educational scenarios.
Cross-Platform Asset & Media Systems: Implemented and refined remote asset loading workflows using Addressables and Amazon S3, and extended Smart Gallery with custom content types for interactive educational media.
Development Tools & Platform Integration: Built reusable Unity packages, custom editor utilities, and WebGL JavaScript plug-ins to streamline development, improve browser integration, and support maintainability across Windows, Android, and WebGL.
Interactive Classroom Features: Developed teacher-controlled session flows, player identification, synchronized activity logs, text chat, and classroom management interfaces.

🤝 How I Contributed

Led Unity development across gameplay systems, multiplayer networking, educational authoring tools, character customization, and cloud integrations.
Designed and implemented interconnected systems for Windows, Android, and WebGL, addressing cross-platform compatibility, performance, and maintainability.
Architected cloud-backed content and networking workflows using Amazon S3 and Photon Fusion, connecting persistent data, remotely delivered content, and synchronized gameplay.
Developed both user-facing runtime editors for educators and internal development tools to streamline content creation and engineering workflows.
Collaborated across disciplines on technical planning, feature development, debugging, integration, and optimization.

🧩 Challenges & Solutions

🌐 Challenge: Synchronized Multiplayer Classrooms

Educational activities required consistent player and classroom states across connected users, including teacher-controlled interactions, scene transitions, and participants joining sessions already in progress.

✔ Solution: Designed multiplayer workflows using Photon Fusion 2.1, synchronizing player data, room states, educational activities, and teacher-driven interactions while supporting session continuity.

🧭 Challenge: Navigation in Dynamic Environments

NPCs needed to navigate environments that could be modified during gameplay, making traditional static navigation solutions insufficient.

✔ Solution: Implemented runtime NavMesh adaptation and autonomous NPC behaviors, enabling navigation and interactions within modular, player-created environments.

🧑‍🏫 Challenge: Accessible Educational Content Creation

Teachers needed to create and personalize interactive learning experiences, including their own NPCs, without depending on developers or external authoring software.

✔ Solution: Developed in-game editors and data-driven systems for configuring lessons, activities, dialogues, characters, and multimedia content directly within MetaClase.

💾 Challenge: Cross-Platform Content Delivery

Supporting Windows, Android, and WebGL introduced platform-specific constraints involving asset loading, remote content management, and browser memory limitations.

✔ Solution: Refined content delivery workflows using Addressables and Amazon S3, alongside platform-specific integrations and optimizations to support consistent application behavior.

🎙️ Challenge: Interactive Speech & AI Integration

Educational interactions required responsive character dialogue, spoken feedback, and speech recognition capabilities for language-oriented activities.

✔ Solution: Integrated Azure text-to-speech with SALSA LipSync, implemented speech recognition for educational minigames, and connected speech services with OpenAI-powered character interactions.

🛠️ Challenge: Maintaining Complex Interconnected Systems

The project combined multiplayer networking, cloud services, AI integrations, runtime content editing, and multiple deployment platforms, increasing integration and maintenance complexity.

✔ Solution: Developed reusable Unity components, custom editor tooling, integration layers, and WebGL JavaScript plug-ins to simplify development workflows and improve maintainability.

🌟 Standout Features

🏫 Multiplayer Classroom

A shared interactive environment where teachers host educational sessions with multiple students. Features synchronized activities, classroom state management, player identification, room codes, text chat, and teacher-controlled interactions.

🧩 In-Game Educational Editors

Runtime authoring tools that allow teachers to create and customize lessons, exercises, dialogues, minigames, and multimedia experiences directly inside MetaClase, without programming knowledge or external development tools.

🎨 Character Customization & NPC Creation

Customizable avatars for teachers and students, alongside educator-defined NPCs that can be incorporated into interactive learning environments. Supports personalized character appearances and the creation of distinct characters for educational scenarios.

🤖 AI-Powered Character Interactions

Character interactions combining OpenAI-powered responses, Azure text-to-speech, and SALSA LipSync, enabling synthesized spoken dialogue accompanied by synchronized character animations.

🎤 Speech-Driven Educational Minigames

Interactive learning activities incorporating Azure speech and language recognition, allowing players to participate through spoken input and practice communication-oriented skills.

🌍 Dynamic Environments & NPC Navigation

Modular environments supporting runtime modifications, autonomous NPC behaviors, and dynamic navigation updates, allowing interactive spaces to adapt to changes made during gameplay.

Project Overview

Links

Technologies: