Experiences
The LEAP Group application and simulation team designs and develops mixed reality, multi-sensory, and interactive digital experiences to expand access, engagement, and depth in learning. These experiences are focused on education for manufacturing and micro/nanotechnology and are categorized into three key areas: (i) apps, (ii) simulations, and (iii) haptics.
XR Applications
Machining in the Dorm Room
MITDR is an open-ended Virtual Reality (VR) system designed to train users in drilling using a 3-axis milling machine. The VR simulation includes onboarding for the experience, a safety module, machine setup and drilling tutorial, and the option for open-ended practice. Learners engage with instructional guides through an assessment of drilled hole geometries against an engineering drawing, with warnings to correct engagement and errors for feedback on performance. This work was recognized as a demo finalist in ACM CHI 2024 and published in IEEE ISMAR 2023.
Product Teardown
These apps enable learners to manipulate, and virtually disassemble various parts and products (representing high-volume manufacturing processes), while receiving scaffolded guidance to inspect manufacturing features. This work won the best paper of ASEE 2021 Professional Council II and the best paper award of ASEE 2021 manufacturing division.
Scanning Electron Microscope (SEM)
This AR app introduces the purpose, function, and working principles of the Scanning Electron Microscope.
Machine Shop Skills
This set of AR apps enable blended learning of machining hands-on skills. These instructional modules can be experienced before a student steps into the machine shop to prepare, or during the course to augment in-person instruction.
Simulations
AFM Image Artifact Simulation
This simulation enables visualization of imaging artifacts of the Atomic Force Microscope (AFM). Students can manipulate parameters such as tip shape, surface profile, and tip cleanliness, and compare the actual surface to the imaged profile.
Kits
AFM Haptics and Visualization
This visualization and haptic feedback controller kit enables students to see and “feel” the forces acting on the Atomic For Microscope (AFM) tip to enable multi-modal learning of mechanical principles on the nanometer scale. This work was most recently published in Nisal Ovitigala’s thesis.