Projects
3D Reconstruction of Endoscopic Image
- Stereo Correpsondence based on Pyramid Stereo Matching Network
- Ground Truth Cleaning (RGB and Depth alignment) based on Iterative Closest Point
- Ranked 4th in 2019 MICCAI SCARED Challenge
- More information about the method
Real-Time Telepresence
- Using Azure Kinect and Microsoft HoloLens 2
- Audience Award (best project award) for Medical Augmented Reality Summer School 2019
- More information: Teleporting the Expert Surgeon into Your OR
ARAMIS
- Augmented Realiy Assistance for Minimally-Invasive Surgery
- CUDA-accelerated Semi-Global Block Matching algorithm
- Real-time streaming and visualization on HoloLens
- Paper accepted for oral presentation at MICCAI 2019
Restoring the Lost Awareness Caused by HMD Occlusion
- Current OST-HMDs occlude part of user’s peripheral vision
- We use screen edge or LED indicators to restore the loss awareness
- Paper accepted for ISMAR 2018 and IEEE TVCG
ARssist
- ARssist - Augmented Reality in Robotic Surgery
- Precise overlay of robotic instrument and endoscope FOV indicator
dVRK Mixed Reality Extension
- The Rationale behind dVRK-XR
- Enable mixed reality research for da Vinci Research Kit
Display Calibration for Optical HMDs
- 3D-3D registration between the real world space and virtual space
ARToolKit for HoloLens
- Open source repo
- Native wrapper for ARToolKit library for UWP
- Performance optimization for HoloLens
- More information about ARToolKit on HoloLens
Augmented Reality for Combat Medics Training
An Ethernet-to-FireWire Bridge
- To ease the low-level communication for da Vinci Research Kit
