MRGeM

Role: Lead Developer

When: 2021 - 2023

Showcasing:

  • Reading, writing and publishing research papers

  • Conducting REB-compliant user studies

  • Unreal Engine 4 Microsoft Hololense Development

    • Custom Gesture and Hand/Bone Tracking

    • UI Design and Implementation

    • Graphics Optimization for AR

  • Bridged the gap between scientific research and software development to build realistic timeline

  • Implementing SQL interfaces

Demo

The Project:

  • While working at TMU’s (Toronto Metropolitan University), I collaborated with Roozbeh to create a Mixed Reality application that transforms how we interact with geospatial data. Leveraging my background in video game development, I helped turn this vision into functional software using Unreal Engine 4 and the Microsoft HoloLens.

    MRGeM allows users to intuitively interact with geospatial data through natural gestures and hand/bone tracking. My experience in developing immersive environments and user-friendly interfaces from video games was invaluable. Conducting REB-compliant user studies helped gather essential feedback, while implementing SQL interfaces was necessary to work with the Catalogue Of Somatic Mutations In Cancer (COSMIC) Database.

    Throughout the project, I led the programming efforts, ensuring Roozbeh's vision was realized with precision. This project enhanced my skills in MR development and demonstrated the importance of combining interdisciplinary approaches in technical design.

The “Mixed Reality for Genetic Mutation Data Exploration” is a research project about building grounded AR solutions for analysis of large databases such as the Catalogue Of Somatic Mutations In Cancer (COSMIC). The project is managed at TMU’s SynLab under the stewardship of Ali Mazalek, Canada Research Chair in Digital Media and Innovation, with insight from Roozbeh Manshaei, Senior Bioinformatician at SickKids.

In Engine Interaction Demonstration

The Inspiration:

The inspiration for MRGeM was a fusion of my passion for video game development and Roozbeh’s visionary approach to geospatial data interaction. A key influence was the Tangible Biological Networks (TBNets) project, which uses interactive displays to explore biological data. This concept resonated with my goal of making complex data more accessible.

My favorite games, like Subnautica, emphasize exploration and discovery. I aimed to create a similar experience with MRGeM—intuitive and user-driven. By trusting the user's curiosity and providing natural, responsive tools, we created an application that is both powerful and easy to use.

Leading the programming efforts, I ensured the project aligned with our goals of creating a seamless and immersive experience. This project is a testament to the power of combining disciplines to create something truly innovative and functional

TBNets demo video

Explore The Project

  • IEEE Xplore Paper

    Designing a Mixed Reality System for Exploring Genetic Mutation Data of Cancer Patients

    Visit

  • Synlab Website

    Research lab where I developed, designed and taught.

    Visit