Meta Reality Labs - XR Foundation

Created VR powered wheelchair training simulator “WheelUp” with Unreal Engine 5 and OpenXR. We utilize user participatory design to develop novel interfaces for diverse bodies and advocate for their needs. Initial technical paper published at IEEE COG 2023.

• Created a VR wheelchair training simulator in Unreal Engine 5 with diverse bodies in mind for physical therapy and rehabilitation

• Achieved Photorealistic VR Rendering by utilizing Global Illumination and Virtualized Geometry with outsourced graphics

• Simulated wheelchair with Chaos Physics, considering different wheel composition, weight distribution, and motor torque curve

• Reduced 80% of motion sickness occurrence by optimized refresh rate, render latency, and quality, designed hardware rotator

• Collected, visualized, and analyzed participant playtest data with the help of LLMs, developed with participatory design principles

• Published first-author technical paper on IEEE Conference on Games, conducted testings with wheelchair-bound participants

Systems & Engine Lead in team working on NVIDIA open-source research game “FPSci”. We research, develop, play-test, and evaluate to explore the effects of network latency and compensation techniques like Time Warp on player experience and performance in First Person Shooter games. Academic paper is being published.

• Networked Nvidia’s C++ single player FPS game “FPSci” to support industry standard Server-Authoritative Multiplayer

• Designed and implemented client-server structure to allow latency compensation techniques like Time Warp and Prediction

• Conducted 30-min testings with 50 testers to record gameplay data under various network and optimization configurations

• Improving player performance by 38%, based on conducting various evaluations of the effects of mitigation techniques

• Wrote first-author technical paper submitted to Nvidia and WPI, and second-author paper submitted to ACM CHI (under review)

Design and develop NPC behavior and new player interaction features on GTA VI.

• Delivered 130 character behavior features or improvements, from design, implementation, documentation, debugging, to testing

• Implemented novel and interdisciplinary player interactions feature by working with departments from studios around the globe

• Programmed game and engine for new behavior definition files, integrating myself into most aspects of the department’s work

• Created 30 multi-model flowchart documentation for character and NPC in-game behaviors, react to questions in time

• Worked with Perforce source control and Rockstar CI/CD pipeline, testing, and reviewing procedures

Research data collection, analysis, and visualization for WPI Global Lab