Cleaning Day

Hello. This is Matsui. I’m an M1 student in IMD Lab.

We cleaned our laboratory room on 15th March. Laboratory members cleaned not only floor but also outside/inside of windows, drawers and so on !

We carried out from 11 AM to 5 PM. Our laboratory became tidy and clean.



I hope this condition will be kept for a long time .

Internship at University of Oulu -final report-

I’m Yuma Ouchi, M1 student. I have finished internship for one month at University of Oulu, so I would like to make a final report on it.

As I wrote in the interim report, I learned the basis of multi-view stereo in this internship. The reason for setting this theme is that it is an important task to generate 3D models from 2D images of human in my research.

The above images are 3D point cloud generated using multi-view stereo algorithm. The left is obtained from 16 input images, and the right is obtained from 312 input images. From this result, we can see that 3D reconstruction with multi-view stereo requires many input images.

I would like to realize 3D reconstruction using as few cameras as possible in a large space. Therefore, it turned out that it is insufficient only with multi-viewpoint stereo approach. Therefore, it turned out that the current multi-viewpoint stereo approach alone is insufficient. Ultimately, Prof.Janne proposed a method using machine learning, so the direction that I should address in the future was clarified.

Next, I would like to mention Finland.  The temperature will be less than -10 ° C under the influence of radiation cooling phenomenon on sunny days. At that time it was the limit to walk outside of 10 minutes. However, life in Oulu was very comfortable. There was a shopping mall in one minute on foot from the hotel, and some stores were open late at night. And, above all, the cityscape is beautiful.

Although it was a short period, I had a valuable experience. I would like to engage in research by taking advantage of experience in Oulu.


Hello. This is Matsui. I’m an M1 student in IMD Lab.
I attended SIG-MR which was held in Kyoto University from January 19th to 20th. This was a joint conference held in cooperation with CVIM, PRMU, MVE, CEA. As a result, I had the privilege of listening to many interesting presentations from various fields.

My presentation was on the first day. Surely everything was not perfect, but I believe it all went well considering the fact that it was my first presentation. I received a lot of questions and comments about our method and experiments. I hope the listeners were satisfied with my answers. 🙂


During the second day, I presented my poster and attended to lots of other poster sessions. I talked with not only researchers from SIG-MR, but also professionals from another conferences. Eventually, I got many additional comments from different aspects.


Preparing the presentation was a hard task for me. Also, I personally felt that the trip to Kyoto University was hard due to it being a one day round-trip. It took so long time to go there and come back…

I will continue to work on this study with SIG-MR experience during the following days. I hope I can produce good results in the near future.
Thank you for time and I wish to you the best.

Internship at University of Oulu -interim report-

I’m Yuma Ouchi, M1 student.
Currently I am studying abroad as internship student for one month at University of Oulu. Since half of the internship period has passed, I will make an interim report.

I belong to the group of Prof. Janne in Department of Computer Science and Engineering. In this internship, I decided to learn the basis of multi-view stereo while discussing with Prof. Janne. At first I don’t have confidence in my English ability, but I can somehow discuss with him because he can listen to my unclear English.

In my department, one room is allocated to about 2 to 4 people. Below is the state of my laboratory.




There are two Chinese students in the same room. For that reason, despite studying in Finland, I usually act with Chinese students. Last weekend I had traditional Chinese dishes at the student dormitory. I appreciate their support for everything around me.




Next, I would like to mention Finland. Before studying abroad, I was worried that it was too cold to bear. But It was okay as it was past the cold peak. Sensually it is almost the same as Sapporo that I went there one month ago. Having said that, the sunshine time in this time of Finland is too short (about 5-6 hours). And, because I am in the university during the day, I feel that I have not seen the cityscape of bright time yet.

It may seem like Finnish negative publicity so far, but actually I am enjoying including such things.

I will make a final report after returning Japan.

Internship at NARVIS Lab.

Hello, I’m Ryo Akiyama who became D1 student from this October.

I did an internship at NARVIS Lab. which is supervised by Prof. Nasir Navab for about two month. The project that I participated in there was using a projector as a surgery lamp in order to support surgery with a HMD. In the lab, they implemented the system that show AR born using an optical see-through HMD to support surgery. However, surgery lamp projects bright light equally, and in that environment, OST-HMD cannot product enough contrast, so it is difficult to see AR contents. In addition, if HMD shows just AR contents with overlaying to human body, we do not perceive that AR contents are inside of body. We tend to feel that AR contents are floating. Our idea to solve the problem is that replacing a surgery lamp with a projector, and control its brightness of AR area in order to get enough contrast and decreasing floating perception.



Before implementing that system in real scene, I implemented simple simulation to create projecting images when viewpoint of HMD user moves. This is my main progress during my stay. There are two window, left one is view from HMD user and the right one is simulated image for projecting. This time, we did not use real medical data to begin from easy situation. We used famous bunny 3D model as a projected object(this will be patient in the future), and simple triangle as an AR content(this will be AR bone or other medical AR contents). From HMD view, we see same triangle even when change the viewpoint. And right window creates image for projection from a fixed projector.

Simulation program that I made during the internship

Simulation program that I made during the internship

From here, I will tell you about few things in Munich. Munich is very beautiful city with historical buildings, and there are many transportation like train, subway or trams, so very easy to access almost anywhere in Munich. Also, during my stay, Christmas Market has began since the end of November at many places in Munich. In Christmas Market, Gluhwein(mulled wine. hot and sweet.) is very popular, and they are usually served with a mug. It tastes very good, and I got some mugs as souvenirs. I also went to Neuschwanstein Castle which is well known as a model of the Cinderella castle. It was snowy when I went there, so I saw the castle in the snow.

Christmas Market at Marien Platz

Christmas Market at Marien Platz

Neuschwanstein Castle

Neuschwanstein Castle

My days in Munich was not so long, but it was really good experience. I wish I can go to Munich again if possible.

Thank you for reading!!

SI 2016

Hello, your favorite D1 student Oral is here, again.

Between 15th – 17th of December 2016, I participated in System Integration 2016 conference held in Sapporo, Hokkaido, Japan. It was a national conference where you can see presentations prepared in Japanese only. So, I also had to do my presentation in Japanese, which was a thrilling experience. I believe for a foreigner, this kind of experience is quite a unique challenge and I will be honest, I enjoyed every little bit of it.

I introduced one of the works that I am doing in our laboratory, which is actually a research work belonging to Professor Yasuhide Yoshitake from NIFS in Kanoya. To put it simply, we are trying to increase the motivation and effectiveness in regular exercise methods designed for elderly by using gamification. To achieve that, currently I am trying to develop a rhythm game where the player is expected to control the avatar through squat movement and capture the gliding note symbols. It is a quite simple game both in idea and design, and currently we are interested in the effects of our approach on elderly. In February, probably I will be in Kanoya; helping with the long term experiments which we are currently planning.

Ok, enough talk about the work. Sapporo; Hokkaido in general, is a beautiful place with beautiful nature, delicious food and cute ladies. 🙂 As a foreigner, I recommend you to visit Hokkaido if you have the chance, but maybe you would go there during the summer. During my stay, it was almost always below 0 degrees and constantly snowing. Makes it fun if you like snow though!

As always, I am leaving you with a couple of pictures that I took during my stay. Enjoy!

Our sexy shot

Our sexy shot

Snow, snow everywhere...

Snow, snow everywhere…

Crows, crows everywhere...

Crows, crows everywhere…





Sports Engineering Panel

Sports Engineering Panel

Internship at University of Oulu -Final Report-

Hello all, this is Ryoko Kato from M1 student.
I finnished my internship in University of Oulu, and I returned to Japan on last Friday. I will write final report in Finland.

I belonged to Professor Petri Pulli’s laboratory, and I am a member of the research of the gamification that how technology can support activate isolated young people. Finally, I submitted the presentation file. Through this internship, I think can improve my English skill and deepen understanding of my research.

In previous article, I wrote about my days in Oulu University or Oulu City, So I will write Finnish culture.

Finnish miscellaneous goods and tableware is stylish and user-friendly represented by Marimekko, Iittala and so on.
I visited Ateneum, Kiasma, Design Museum in Helsinki at weekend, because I am interested in ergonomics and art.
I was surprised we can take the photos freely in museum, because it is different from Japanese museum. I think this is good thing because we can remind the details of art after we go back to our home.
Helsinki architecture is famous in the world, I saw it. There are some trams and cool architecture.

In this section, I will mainly introduce about Design Museum.
Alvar Aalto is famous architecture and designer in the world, he born in Finland.
There are some furniture were exhibited in Design Museum that Alvar Aalto was designed.

Furniture For Sanatorium

Furniture For Sanatorium

These furniture is designed by Aalto to be used in sanatorium. I cannot read instruction(because I can’t have enough time…), but I feel that these furniture is tidy and warmly.

In Japan, we can enjoy the arts using our eyes only in Museum. But in Design Museum, we can touch some arts, for example the telephone. Following photo shows rotary dial.(I used rotary dial in my parent’s house 20 years ago:) )

Rotary Dial

Rotary Dial

I felt the earphone is little heavy, and the heavy earphone reminds me of the memories of my childhood.

Now, how the the shapes of telephones changed?



According to this photograph, rotary dial changes to codeless phone and mobile phones.
In design museum, I could see the ergonomic designs.

I think I can feel Finnish culture and deepen understanding of Finnish culture.

In the end of this article, I’d like to thank professor Petri Pulli and IMD professors including Professor Hirokazu Kato for their support for my internship. Thank you very much.

Sunset From Air Plane's Window

Sunset From Air Plane’s Window


Hello. I am D1 student Oral Kaplan.

During October 9-12, I attended to 2016 IEEE Systems, Man, and Cybernetics conference and presented my work with the title of “In-situ Visualization of Pedaling Forces on Cycling Training Videos”. The conference was held in Budapest, Hungary. There were two hotels designated as conference venues; InterContinental and Sofitel. Unlike all other conferences we focus in our laboratory, this conference governs a much broader spectrum. There is no definitive target, instead it includes Brain-Machine Interface (BMI), Human-Computer Interaction (HCI), Robotics, Software Engineering and many more. Although this situation reduces the overall quality of the works, it creates an environment where people can learn about different research fields to broaden their vision.

I participated in many sessions and I believe in general the conference itself was a quite nice experience. The topics that I listened to included eye tracking, advancements in BMI technologies, pattern recognition and image processing, and many more poster sessions about various topics.

There were multiple keynote speakers but maybe the most important one, the opening keynote, was given by Jose M. Carmena from Helen Wills Neuroscience Institute of UC Berkeley, USA. The topic of his talk was about “Advances in Brain-Machine Interface Systems”. The final part of his speech where he explained wireless capture of brain activity was very interesting.

The best student paper award, which I was interested in, was given to the paper titled as “Automated Brain Tumor Segmentation using Kernel Dictionary Learning and Superpixel-level Features”.

I guess this is enough text and enough explanation. I am leaving you with some pictures that I took during the conference and my trip to Budapest.



My poster presentation


Too bad that not everybody can win


From the keynote of Jose M. Carmena : the future of BMI


Conference banquet : this guy really wanted to eat…


Horse show : how to make a horse sit like a dog


The architectural design of buildings in Budapest was fascinating


A church in Budapest


Royal Palace


A little bit of nightlife


There are many nice coffee shops in Budapest and they also serve lots of delicious food


I had to try the kebab there…

Internship at University of Oulu -First Report-

Hello, I am M1 student Ryoko Kato.
I study abroad at University of Oulu as internship student.

I arrived in Oulu City, on 26th September, and 14 days have already passed.
I can’t believe that… The time just flew by.

In this article, I’d like to describe about my life in Oulu.
First, I will write about my days in University of Oulu.

I am belonging to the group of professor Petri Pulli in Department of Information Processing Science as internship student.
I am a member of the research of the gamification that how technology can support activate isolated young people. Recently, gamification is used many applications and service. Gamification the application of game-design elements(e.g. ranking, badges, and more) and game principles in non-game contexts so as to encourage users of the non-game systemcan continue to use the system.
Now, I’m searching the papers or journals that describe characters of the isolated young people. There are many cases of application, and I think it is interesting.

Secondly, I will write about my days in daily life.

My days in University of Oulu
University of Oulu has extensive lands. There are not only school buildings, but also a botanical garden, and a church in the school site.
In particular, the botanical garden is known as famous tourist site in Oulu City.
I’d like to visit the botanical garden during the my internship.

This photograph shows autumn color of leaves in the campus, I can see the beautiful landscape everyday.


Autumn Leaves

My days in Oulu City
Next, I’d like to write about my life in Oulu City.

Oulu City is little colder than Ikoma, Nara. Therefore I wear the sweater everyday, like winter days in Japan, but it’s not too cold to live:)

I visited several tourist spot on every weekend.

Oulun tuomiokirkko

Oulun tuomiokirkko

Nallikari Beach

Nallikari Beach

Kauppuri 5

Kauppuri 5

I’d like to especially write about the aurora.
Fortunately, I can see the aurora in Oulu City on 4th October’s night.
Following photograph is taken by Kushida-san from Optical Media Interface Laboratory.



The right curtain cover the dark sky, and stars blight on the sky…
“Beautiful”, there is nothing else I can say.

If the weather will be gave me a chance, I would like to take photograph of the aurora by my camera.
In the end of this article, I’d like to thank professor Petri Pulli and IMD professors for their support for my internship.

Kiitos!!(Thank you.)

Report of Visiting Tokyo Institute of Technology

Hello, all.
This is Ryoko Kato, M1 Student.

On 8 July, I visit Professor Sato’s laboratory in Tokyo Institute of technology to presence the technology transfer of SPIDAR-W: SPIDAR-W is a wearable haptic device.
I’d like to thank Professor Sato allowing me to attend the technology transfer.

SPIDAR is haptic interface to give the force feedback to users using motors.
Professor Sato’s laboratory developed SPIDAR-G: users operate a sphere and they can get the force feedback from SPIDAR-G, SPIDAR-MF: users move their fingers attached with strings and they can get the force feedback from SPIDAR-MF, and many haptic devices.
I’d like develop the haptic system using SPIDAR-MF and Augumented Reality on my research.

In this day, Professor Sato and Professor Akahane give me the advice for my research, and I go through a few demonstration of SPIDAR-G.

* Observing students constructing SPIDAR-W
* To Use haptic system using SPIDAR-G
* Watching a video of SPIDAR-G

To use haptic system using SPIDAR-G left an strong impression on me.


Demonstration of SPIDAR-G

Through this opportunity, my motivation towards my research is raise.
However, I felt I should have to learn more wide field of knowledge.

I’d like conclude this article with photograph of a delicious lunch.

Thank you.


School Cafeteria’s Qeema Curry

Ryoko Kato