Category Archives: 未分類


Hello. This is Matsui. I’m an M1 student in IMD Lab.
I attended SIG-MR which was held in Kyoto University from January 19th to 20th. This was a joint conference held in cooperation with CVIM, PRMU, MVE, CEA. As a result, I had the privilege of listening to many interesting presentations from various fields.

My presentation was on the first day. Surely everything was not perfect, but I believe it all went well considering the fact that it was my first presentation. I received a lot of questions and comments about our method and experiments. I hope the listeners were satisfied with my answers. 🙂


During the second day, I presented my poster and attended to lots of other poster sessions. I talked with not only researchers from SIG-MR, but also professionals from another conferences. Eventually, I got many additional comments from different aspects.


Preparing the presentation was a hard task for me. Also, I personally felt that the trip to Kyoto University was hard due to it being a one day round-trip. It took so long time to go there and come back…

I will continue to work on this study with SIG-MR experience during the following days. I hope I can produce good results in the near future.
Thank you for time and I wish to you the best.

Internship at University of Oulu -interim report-

I’m Yuma Ouchi, M1 student.
Currently I am studying abroad as internship student for one month at University of Oulu. Since half of the internship period has passed, I will make an interim report.

I belong to the group of Prof. Janne in Department of Computer Science and Engineering. In this internship, I decided to learn the basis of multi-view stereo while discussing with Prof. Janne. At first I don’t have confidence in my English ability, but I can somehow discuss with him because he can listen to my unclear English.

In my department, one room is allocated to about 2 to 4 people. Below is the state of my laboratory.




There are two Chinese students in the same room. For that reason, despite studying in Finland, I usually act with Chinese students. Last weekend I had traditional Chinese dishes at the student dormitory. I appreciate their support for everything around me.




Next, I would like to mention Finland. Before studying abroad, I was worried that it was too cold to bear. But It was okay as it was past the cold peak. Sensually it is almost the same as Sapporo that I went there one month ago. Having said that, the sunshine time in this time of Finland is too short (about 5-6 hours). And, because I am in the university during the day, I feel that I have not seen the cityscape of bright time yet.

It may seem like Finnish negative publicity so far, but actually I am enjoying including such things.

I will make a final report after returning Japan.

Internship at NARVIS Lab.

Hello, I’m Ryo Akiyama who became D1 student from this October.

I did an internship at NARVIS Lab. which is supervised by Prof. Nasir Navab for about two month. The project that I participated in there was using a projector as a surgery lamp in order to support surgery with a HMD. In the lab, they implemented the system that show AR born using an optical see-through HMD to support surgery. However, surgery lamp projects bright light equally, and in that environment, OST-HMD cannot product enough contrast, so it is difficult to see AR contents. In addition, if HMD shows just AR contents with overlaying to human body, we do not perceive that AR contents are inside of body. We tend to feel that AR contents are floating. Our idea to solve the problem is that replacing a surgery lamp with a projector, and control its brightness of AR area in order to get enough contrast and decreasing floating perception.



Before implementing that system in real scene, I implemented simple simulation to create projecting images when viewpoint of HMD user moves. This is my main progress during my stay. There are two window, left one is view from HMD user and the right one is simulated image for projecting. This time, we did not use real medical data to begin from easy situation. We used famous bunny 3D model as a projected object(this will be patient in the future), and simple triangle as an AR content(this will be AR bone or other medical AR contents). From HMD view, we see same triangle even when change the viewpoint. And right window creates image for projection from a fixed projector.

Simulation program that I made during the internship

Simulation program that I made during the internship

From here, I will tell you about few things in Munich. Munich is very beautiful city with historical buildings, and there are many transportation like train, subway or trams, so very easy to access almost anywhere in Munich. Also, during my stay, Christmas Market has began since the end of November at many places in Munich. In Christmas Market, Gluhwein(mulled wine. hot and sweet.) is very popular, and they are usually served with a mug. It tastes very good, and I got some mugs as souvenirs. I also went to Neuschwanstein Castle which is well known as a model of the Cinderella castle. It was snowy when I went there, so I saw the castle in the snow.

Christmas Market at Marien Platz

Christmas Market at Marien Platz

Neuschwanstein Castle

Neuschwanstein Castle

My days in Munich was not so long, but it was really good experience. I wish I can go to Munich again if possible.

Thank you for reading!!

SI 2016

Hello, your favorite D1 student Oral is here, again.

Between 15th – 17th of December 2016, I participated in System Integration 2016 conference held in Sapporo, Hokkaido, Japan. It was a national conference where you can see presentations prepared in Japanese only. So, I also had to do my presentation in Japanese, which was a thrilling experience. I believe for a foreigner, this kind of experience is quite a unique challenge and I will be honest, I enjoyed every little bit of it.

I introduced one of the works that I am doing in our laboratory, which is actually a research work belonging to Professor Yasuhide Yoshitake from NIFS in Kanoya. To put it simply, we are trying to increase the motivation and effectiveness in regular exercise methods designed for elderly by using gamification. To achieve that, currently I am trying to develop a rhythm game where the player is expected to control the avatar through squat movement and capture the gliding note symbols. It is a quite simple game both in idea and design, and currently we are interested in the effects of our approach on elderly. In February, probably I will be in Kanoya; helping with the long term experiments which we are currently planning.

Ok, enough talk about the work. Sapporo; Hokkaido in general, is a beautiful place with beautiful nature, delicious food and cute ladies. 🙂 As a foreigner, I recommend you to visit Hokkaido if you have the chance, but maybe you would go there during the summer. During my stay, it was almost always below 0 degrees and constantly snowing. Makes it fun if you like snow though!

As always, I am leaving you with a couple of pictures that I took during my stay. Enjoy!

Our sexy shot

Our sexy shot

Snow, snow everywhere...

Snow, snow everywhere…

Crows, crows everywhere...

Crows, crows everywhere…





Sports Engineering Panel

Sports Engineering Panel

Internship at University of Oulu -Final Report-

Hello all, this is Ryoko Kato from M1 student.
I finnished my internship in University of Oulu, and I returned to Japan on last Friday. I will write final report in Finland.

I belonged to Professor Petri Pulli’s laboratory, and I am a member of the research of the gamification that how technology can support activate isolated young people. Finally, I submitted the presentation file. Through this internship, I think can improve my English skill and deepen understanding of my research.

In previous article, I wrote about my days in Oulu University or Oulu City, So I will write Finnish culture.

Finnish miscellaneous goods and tableware is stylish and user-friendly represented by Marimekko, Iittala and so on.
I visited Ateneum, Kiasma, Design Museum in Helsinki at weekend, because I am interested in ergonomics and art.
I was surprised we can take the photos freely in museum, because it is different from Japanese museum. I think this is good thing because we can remind the details of art after we go back to our home.
Helsinki architecture is famous in the world, I saw it. There are some trams and cool architecture.

In this section, I will mainly introduce about Design Museum.
Alvar Aalto is famous architecture and designer in the world, he born in Finland.
There are some furniture were exhibited in Design Museum that Alvar Aalto was designed.

Furniture For Sanatorium

Furniture For Sanatorium

These furniture is designed by Aalto to be used in sanatorium. I cannot read instruction(because I can’t have enough time…), but I feel that these furniture is tidy and warmly.

In Japan, we can enjoy the arts using our eyes only in Museum. But in Design Museum, we can touch some arts, for example the telephone. Following photo shows rotary dial.(I used rotary dial in my parent’s house 20 years ago:) )

Rotary Dial

Rotary Dial

I felt the earphone is little heavy, and the heavy earphone reminds me of the memories of my childhood.

Now, how the the shapes of telephones changed?



According to this photograph, rotary dial changes to codeless phone and mobile phones.
In design museum, I could see the ergonomic designs.

I think I can feel Finnish culture and deepen understanding of Finnish culture.

In the end of this article, I’d like to thank professor Petri Pulli and IMD professors including Professor Hirokazu Kato for their support for my internship. Thank you very much.

Sunset From Air Plane's Window

Sunset From Air Plane’s Window


Hello. I am D1 student Oral Kaplan.

During October 9-12, I attended to 2016 IEEE Systems, Man, and Cybernetics conference and presented my work with the title of “In-situ Visualization of Pedaling Forces on Cycling Training Videos”. The conference was held in Budapest, Hungary. There were two hotels designated as conference venues; InterContinental and Sofitel. Unlike all other conferences we focus in our laboratory, this conference governs a much broader spectrum. There is no definitive target, instead it includes Brain-Machine Interface (BMI), Human-Computer Interaction (HCI), Robotics, Software Engineering and many more. Although this situation reduces the overall quality of the works, it creates an environment where people can learn about different research fields to broaden their vision.

I participated in many sessions and I believe in general the conference itself was a quite nice experience. The topics that I listened to included eye tracking, advancements in BMI technologies, pattern recognition and image processing, and many more poster sessions about various topics.

There were multiple keynote speakers but maybe the most important one, the opening keynote, was given by Jose M. Carmena from Helen Wills Neuroscience Institute of UC Berkeley, USA. The topic of his talk was about “Advances in Brain-Machine Interface Systems”. The final part of his speech where he explained wireless capture of brain activity was very interesting.

The best student paper award, which I was interested in, was given to the paper titled as “Automated Brain Tumor Segmentation using Kernel Dictionary Learning and Superpixel-level Features”.

I guess this is enough text and enough explanation. I am leaving you with some pictures that I took during the conference and my trip to Budapest.



My poster presentation


Too bad that not everybody can win


From the keynote of Jose M. Carmena : the future of BMI


Conference banquet : this guy really wanted to eat…


Horse show : how to make a horse sit like a dog


The architectural design of buildings in Budapest was fascinating


A church in Budapest


Royal Palace


A little bit of nightlife


There are many nice coffee shops in Budapest and they also serve lots of delicious food


I had to try the kebab there…

Internship at University of Oulu -First Report-

Hello, I am M1 student Ryoko Kato.
I study abroad at University of Oulu as internship student.

I arrived in Oulu City, on 26th September, and 14 days have already passed.
I can’t believe that… The time just flew by.

In this article, I’d like to describe about my life in Oulu.
First, I will write about my days in University of Oulu.

I am belonging to the group of professor Petri Pulli in Department of Information Processing Science as internship student.
I am a member of the research of the gamification that how technology can support activate isolated young people. Recently, gamification is used many applications and service. Gamification the application of game-design elements(e.g. ranking, badges, and more) and game principles in non-game contexts so as to encourage users of the non-game systemcan continue to use the system.
Now, I’m searching the papers or journals that describe characters of the isolated young people. There are many cases of application, and I think it is interesting.

Secondly, I will write about my days in daily life.

My days in University of Oulu
University of Oulu has extensive lands. There are not only school buildings, but also a botanical garden, and a church in the school site.
In particular, the botanical garden is known as famous tourist site in Oulu City.
I’d like to visit the botanical garden during the my internship.

This photograph shows autumn color of leaves in the campus, I can see the beautiful landscape everyday.


Autumn Leaves

My days in Oulu City
Next, I’d like to write about my life in Oulu City.

Oulu City is little colder than Ikoma, Nara. Therefore I wear the sweater everyday, like winter days in Japan, but it’s not too cold to live:)

I visited several tourist spot on every weekend.

Oulun tuomiokirkko

Oulun tuomiokirkko

Nallikari Beach

Nallikari Beach

Kauppuri 5

Kauppuri 5

I’d like to especially write about the aurora.
Fortunately, I can see the aurora in Oulu City on 4th October’s night.
Following photograph is taken by Kushida-san from Optical Media Interface Laboratory.



The right curtain cover the dark sky, and stars blight on the sky…
“Beautiful”, there is nothing else I can say.

If the weather will be gave me a chance, I would like to take photograph of the aurora by my camera.
In the end of this article, I’d like to thank professor Petri Pulli and IMD professors for their support for my internship.

Kiitos!!(Thank you.)

Report of Visiting Tokyo Institute of Technology

Hello, all.
This is Ryoko Kato, M1 Student.

On 8 July, I visit Professor Sato’s laboratory in Tokyo Institute of technology to presence the technology transfer of SPIDAR-W: SPIDAR-W is a wearable haptic device.
I’d like to thank Professor Sato allowing me to attend the technology transfer.

SPIDAR is haptic interface to give the force feedback to users using motors.
Professor Sato’s laboratory developed SPIDAR-G: users operate a sphere and they can get the force feedback from SPIDAR-G, SPIDAR-MF: users move their fingers attached with strings and they can get the force feedback from SPIDAR-MF, and many haptic devices.
I’d like develop the haptic system using SPIDAR-MF and Augumented Reality on my research.

In this day, Professor Sato and Professor Akahane give me the advice for my research, and I go through a few demonstration of SPIDAR-G.

* Observing students constructing SPIDAR-W
* To Use haptic system using SPIDAR-G
* Watching a video of SPIDAR-G

To use haptic system using SPIDAR-G left an strong impression on me.


Demonstration of SPIDAR-G

Through this opportunity, my motivation towards my research is raise.
However, I felt I should have to learn more wide field of knowledge.

I’d like conclude this article with photograph of a delicious lunch.

Thank you.


School Cafeteria’s Qeema Curry

Ryoko Kato

NARVIS-NAIST Bilateral Workshop on Medical Augmented Reality

Howdy readers! PhD student Damien Constantine Rompapas reporting here!

In late May – Early June, Several of my colleagues and I travelled far to the land of Munich, Germany to participate in the NARVIS-NAIST Bilateral Workshop on Medical Augmented Reality.

The main purpose of this workshop was to nurture collaborations between the Interactive Media Design lab at NAIST and the NARVIS Medical Augmented Reality lab.


The first morning was the first day of presentations, but I arrived earlier to explore TU Munich. The first sight I came across was a massive 4 story slide, making a trip from the 4th floor to the ground floor exciting and fun! (And it certainly was fun to slide in :D).

After that we got a little more serious, and started the presentations, which lasted the first two days.

We heard some amazing research being done by the guys in TU Munich (Which spoke about a range of Medical Applications in Computer Science), as well as some research from our university (Which was more heavy on Augmented Reality), I myself presented my research on EyeAR.

Afterwards we got to enjoy some of the local food (and beer) in Germany. Beginning with a huge leg of

Mmmmm delicious pork leg is delicious

Mmmmm delicious pork leg is delicious

sadly however, I couldn’t finish the huge leg of duck!

Waaah, I couldnt finish it all :c

Waaah, I couldnt finish it all :c

Before heading home, I came across an…. interesting and enticing site!

This statues golden breast is said to give good luck... I SWEAR!

This statues golden breast is said to give good luck… I SWEAR!

In the second day, we heard an interesting talk about Medical Augmented Reality by Professor Nassir! whose lab we visited afterwards. The first place to visit was in the FAR lab, where we saw some cool augmented tabletop Tower Defense games (unfortunately I do not have photos of these). The second place we visited was the Computer Vision and Machine Learning lab! It was here we saw how machine learning can be used to recognize objects in a scene in real-time! (Again, no pictures. sorry!).

Later that evening there was a wine tasting!

*sip sip*  ah,  nothing like a little french wine to end the day.

*sip sip* ah, nothing like a little french wine to end the day.

The third day we took a tour around some of the other TU Munich campuses, and saw many awesome demos! we first visited the NARVIS lab, where we saw a cool combination of Haptics and Augmented Reality for Medical Procedures!

Ok.... carefully insert the pin into the spine... no worries.... This device simulates a live operation on the spines bones.

Ok…. carefully insert the pin into the spine… no worries…. This device simulates a live operation on the spines bones.

We can not see it for ourselves, but Ulrich here is plotting a course for a brain surgeon to cut into the brain avoiding critical parts

We can not see it for ourselves, but Ulrich here is plotting a course for a brain surgeon to cut into the brain avoiding critical parts

After which we had a small lunch break………

There is only one who can handle this much pizza. GIMME!

There is only one who can handle this much pizza. GIMME!

We then took a visit to a Simulation Center for Emergency Medicine, where scenarios are planned and then performed with everything hooked up to a central control room. This allowed the director running the simulation to create interesting scenarios for the medical team to encounter.

(For example, there was a dummy hooked up to some external sensors, which allowed the dummy to become warm/cold, and the monitors hooked up to the dummy produced synthesized heart readings).

The bed actually is hooked up with various network devices to simulate things like a broken wheel!

The bed actually is hooked up with various network devices to simulate things like a broken wheel!


The final day brought us to the IFL lab that’s inside the medical hospital! A lot of weird and exciting demonstrations were shown to us! these were mainly focused on Nuclear and Robotics in medicine!

The robot performs this sonogram all by itself!

The robot performs this sonogram all by itself!


YEOUCH! the poor dummy is used as part of an AR rectal camera simulation for training!

YEOUCH! the poor dummy is used as part of an AR rectal camera simulation for training!

The host family I stayed with enjoyed the evening with a little hand-made Japanese Soy Ramen! (Made by yours truly :P)

I really enjoyed Germany, I wish I could have stayed alot longer.


Signing off.


Rompapas Damien Constantine

PhD Student

Interactive Media Design Laboratory

APMR 2016

Hi, I am Arno, a PhD student of the lab. Professor Sandor, Professor Taketomi and me recently participated at the Asia-Pacific Workshop on Mixed Reality (APMR) in Andong, South Korea. The workshop was from the 22nd to the 24th of February, where during first and last day we had time for some sightseeing around Andong area.

On the first day we visited a historical museum and an old village as well as Korea’s largest pedestrian bridge, the moon light bridge.

The moonlight bridge.

The moonlight bridge.

In the evening we had a nice traditional Korean dinner (including quite strong Korean alcohol)IMG_0019The second day consisted of oral presentations. Notably, Prof. Sandor was asked to give a keynote speech, which he had invested a lot of time in.

Professor Sandor during his keynote speech

Professor Sandor during his keynote speech

I gave a speech as well, however, was a bit nervous. I’ll hope to do better next time.

Me presenting

Me presenting

During the presentations we had a nice lunch at the Hotel …

Lunch at the hotel

Lunch at the hotel

… and at the end there was a poster presentation session

Poster session in the Hotel

Poster session in the Hotel

The two best presentations were about hand gesture recognition (KAIST) and virtual carving (Ritsumeikan University). In general, I felt most research relied on machine learning.

My personal highlight was the Korean Barbecue after the poster session.

Korean Barbecue

Korean Barbecue

The third day was the day of departure. But before that we had the chance to visit Hahoe, a historic Korean village and UNESCO world heritage. Interestingly, people are still living in this village, so that most of the buildings were not publicly available. Also many important figures of Korean history had inhabited this village

Hahoe village

Hahoe village

Our tour guide for Hahoe village

Our tour guide for Hahoe village

All in all it was a great experience for me (also it was the first time I visited Korea) and I am grateful to the lab and NAIST for enabling me to participate in this event, as well as to the organizers for having such nice events. However, I will try my best to have a better presentation and results next time.