Tag: augmented-reality

• 3D Reconstruction for Stereo Endoscopic Video (13 Dec 2019)
  This blog describes my experience with 3D reconstruction of stereo endoscopic video, including ARAMIS and MICCAI 2019 EndoVis Challenge (SCARED sub-challenge). We have tried traditional algorithms that optimizes for speed and efficiency, which is implemented in ARAMIS, and also novel deep-learning-based methods to tackle the SCARED challenge.
• Teleporting the Expert Surgeon into Your OR (29 Aug 2019)
  This blog describes our hackathon project "Teleporting the Expert into Your OR" of 2019 Medical Augmented Reality Summer School (MARSS). The summer school was hosted in Balgrist Hospital, Zurich. We use HoloLens2 to visualize a real-time point cloud generated from Azure Kinect.
• The Rationale behind dVRK-XR (21 Jun 2019)
  dVRK-XR is an open source package that helps users to integrate da Vinci Research Kit, or da Vinci robot, with mixed reality platforms. dVRK-XR uses Unity as middleware for deploying virtual reality or augmented reality applications. In this post, I discuss the design rational behind the dVRK-XR.
• ARssist - Augmented Reality in Robotic Surgery (09 Apr 2019)
  We developed an augmented reality application for the bed-side assistant in robotic surgery, called ARssist. ARssist is implemented using Microsoft HoloLens and da Vinci robot. The assistant is able to see virtual overlay of robotic instrument, endoscope and its field-of-view indicator, and the endoscopic video through HoloLens.
• AWE 2017 Highlight (08 Jun 2017)
  Augmented World EXPO 2017 was held in Santa Clara, with 4700 attendee, 351 speakers, 212 exhibitors. AWE is the largest industrial exhibition in the field of Augmented Reality. Some Virtual Reality players attend the conference too. As the concept of AR getting more and more popular, it is time to check out how these concepts come to life. In this post, I will share some of the highlights that I saw during the EXPO.
• ARUWPVideo Options in HoloLensARToolKit v0.2 (15 May 2017)
  Documentation of project HoloLensARToolKit v0.2, the ARUWPVideo script used in HoloLensARToolKit, including the detailed explanation of its attributes, and common usecases.
• ARUWPMarker Options in HoloLensARToolKit v0.2 (15 May 2017)
  Documentation of project HoloLensARToolKit v0.2, the ARUWPMarker script used in HoloLensARToolKit, including the detailed explanation of its attributes, and common usecases.
• Coorindate Systems in HoloLensARToolKit v0.2 (15 May 2017)
  Documentation of project HoloLensARToolKit v0.2, the coordinate systems used in HoloLensARToolKit, including the difference between unity3d coordinates, ARToolKit coordinates and HoloLensARToolKit coordinates.
• ARUWPController Options in HoloLensARToolKit v0.2 (15 May 2017)
  Documentation of project HoloLensARToolKit v0.2, the ARUWPController script used in HoloLensARToolKit, including the detailed explanation of its attributes, and common usecases.
• IEEEVR 2017 Highlight (05 Apr 2017)
  This blog summarizes the highlight of IEEE Virtual Reality 2017 conference held at Los Angeles, California. We presented two posters at the conference. The keynotes, interesting papers, posters, research demos, industrial demos seen by me are summarized in this post.
• Hands on Head-Mounted Displays (03 Apr 2017)
  I have worked with many augmented reality platforms, especially head-mounted displays (HMD). In this post, I would like to share the experience of developing or playing with these head-mounted displays, and hopefully the comparison help you to choose the correct head-mounted display for your applications.
• ARUWPMarker Options in HoloLensARToolKit v0.1 (14 Feb 2017)
  Documentation of project HoloLensARToolKit v0.1, the ARUWPMarker script used in HoloLensARToolKit, including the detailed explanation of its attributes, and common usecases.
• Coorindate Systems in HoloLensARToolKit v0.1 (14 Feb 2017)
  Documentation of project HoloLensARToolKit v0.1, the coordinate systems used in HoloLensARToolKit, including the difference between unity3d coordinates, ARToolKit coordinates and HoloLensARToolKit coordinates.
• ARUWPController Options in HoloLensARToolKit v0.1 (14 Feb 2017)
  Documentation of project HoloLensARToolKit v0.1, the ARUWPController script used in HoloLensARToolKit, including the detailed explanation of its attributes, and common usecases.
• HoloLens File Transfer (08 Feb 2017)
  Interacting with HoloLens application via file IO. A useful trick for communicating with HoloLens.
• HoloLens Video Streaming (07 Feb 2017)
  An applicaiton to stream video output to HoloLens, and to display the virtual video in 3D environment. TCP communication and JPEG compression are applied.
• ARToolKit on HoloLens (20 Jan 2017)
  Demonstration of implementing ARToolKit on HoloLens. The capabilit of using the locatable camera of HoloLens to do fiducial marker tracking is exploited.
• Research Talk at Tongji University (21 Dec 2016)
  A summary of the research talk at Tongji University
• Future Augmented Reality Surgery (26 Oct 2016)
  Future augmented reality surgery scenario, that is still far away from us.
• SmartAR on HMD (18 Oct 2016)
  My course project of Computer Vision at Johns Hopkins University. We used Moverio BT-200 to do marker tracking and object recognition.
• Google Cardboard as "Augmented Reality" Headset (16 Oct 2016)
  Google Cardbard is general used for virtual reality (VR). However, it is not impossible to simulate augmented reality (AR) experience. Here is an experiment.
• ISMAR 2016 Highlight (01 Oct 2016)
  A blog giving you some insights about what is happening in the field of augmented reality research, by looking at the highlights of ISMAR (IEEE International Symposium on Mixed and Augmented Reality) 2016, at Merida, Mexico.