Hello, I’m Ryo Akiyama who became D1 student from this October.
I did an internship at NARVIS Lab. which is supervised by Prof. Nasir Navab for about two month. The project that I participated in there was using a projector as a surgery lamp in order to support surgery with a HMD. In the lab, they implemented the system that show AR born using an optical see-through HMD to support surgery. However, surgery lamp projects bright light equally, and in that environment, OST-HMD cannot product enough contrast, so it is difficult to see AR contents. In addition, if HMD shows just AR contents with overlaying to human body, we do not perceive that AR contents are inside of body. We tend to feel that AR contents are floating. Our idea to solve the problem is that replacing a surgery lamp with a projector, and control its brightness of AR area in order to get enough contrast and decreasing floating perception.
Before implementing that system in real scene, I implemented simple simulation to create projecting images when viewpoint of HMD user moves. This is my main progress during my stay. There are two window, left one is view from HMD user and the right one is simulated image for projecting. This time, we did not use real medical data to begin from easy situation. We used famous bunny 3D model as a projected object(this will be patient in the future), and simple triangle as an AR content(this will be AR bone or other medical AR contents). From HMD view, we see same triangle even when change the viewpoint. And right window creates image for projection from a fixed projector.
Simulation program that I made during the internship
From here, I will tell you about few things in Munich. Munich is very beautiful city with historical buildings, and there are many transportation like train, subway or trams, so very easy to access almost anywhere in Munich. Also, during my stay, Christmas Market has began since the end of November at many places in Munich. In Christmas Market, Gluhwein(mulled wine. hot and sweet.) is very popular, and they are usually served with a mug. It tastes very good, and I got some mugs as souvenirs. I also went to Neuschwanstein Castle which is well known as a model of the Cinderella castle. It was snowy when I went there, so I saw the castle in the snow.
Christmas Market at Marien Platz
My days in Munich was not so long, but it was really good experience. I wish I can go to Munich again if possible.
Thank you for reading!!