SI 2016

Hello, your favorite D1 student Oral is here, again.

Between 15th – 17th of December 2016, I participated in System Integration 2016 conference held in Sapporo, Hokkaido, Japan. It was a national conference where you can see presentations prepared in Japanese only. So, I also had to do my presentation in Japanese, which was a thrilling experience. I believe for a foreigner, this kind of experience is quite a unique challenge and I will be honest, I enjoyed every little bit of it.

I introduced one of the works that I am doing in our laboratory, which is actually a research work belonging to Professor Yasuhide Yoshitake from NIFS in Kanoya. To put it simply, we are trying to increase the motivation and effectiveness in regular exercise methods designed for elderly by using gamification. To achieve that, currently I am trying to develop a rhythm game where the player is expected to control the avatar through squat movement and capture the gliding note symbols. It is a quite simple game both in idea and design, and currently we are interested in the effects of our approach on elderly. In February, probably I will be in Kanoya; helping with the long term experiments which we are currently planning.

Ok, enough talk about the work. Sapporo; Hokkaido in general, is a beautiful place with beautiful nature, delicious food and cute ladies. 🙂 As a foreigner, I recommend you to visit Hokkaido if you have the chance, but maybe you would go there during the summer. During my stay, it was almost always below 0 degrees and constantly snowing. Makes it fun if you like snow though!

As always, I am leaving you with a couple of pictures that I took during my stay. Enjoy!

Our sexy shot

Our sexy shot

Snow, snow everywhere...

Snow, snow everywhere…

Crows, crows everywhere...

Crows, crows everywhere…





Sports Engineering Panel

Sports Engineering Panel

Internship at University of Oulu -Final Report-

Hello all, this is Ryoko Kato from M1 student.
I finnished my internship in University of Oulu, and I returned to Japan on last Friday. I will write final report in Finland.

I belonged to Professor Petri Pulli’s laboratory, and I am a member of the research of the gamification that how technology can support activate isolated young people. Finally, I submitted the presentation file. Through this internship, I think can improve my English skill and deepen understanding of my research.

In previous article, I wrote about my days in Oulu University or Oulu City, So I will write Finnish culture.

Finnish miscellaneous goods and tableware is stylish and user-friendly represented by Marimekko, Iittala and so on.
I visited Ateneum, Kiasma, Design Museum in Helsinki at weekend, because I am interested in ergonomics and art.
I was surprised we can take the photos freely in museum, because it is different from Japanese museum. I think this is good thing because we can remind the details of art after we go back to our home.
Helsinki architecture is famous in the world, I saw it. There are some trams and cool architecture.

In this section, I will mainly introduce about Design Museum.
Alvar Aalto is famous architecture and designer in the world, he born in Finland.
There are some furniture were exhibited in Design Museum that Alvar Aalto was designed.

Furniture For Sanatorium

Furniture For Sanatorium

These furniture is designed by Aalto to be used in sanatorium. I cannot read instruction(because I can’t have enough time…), but I feel that these furniture is tidy and warmly.

In Japan, we can enjoy the arts using our eyes only in Museum. But in Design Museum, we can touch some arts, for example the telephone. Following photo shows rotary dial.(I used rotary dial in my parent’s house 20 years ago:) )

Rotary Dial

Rotary Dial

I felt the earphone is little heavy, and the heavy earphone reminds me of the memories of my childhood.

Now, how the the shapes of telephones changed?



According to this photograph, rotary dial changes to codeless phone and mobile phones.
In design museum, I could see the ergonomic designs.

I think I can feel Finnish culture and deepen understanding of Finnish culture.

In the end of this article, I’d like to thank professor Petri Pulli and IMD professors including Professor Hirokazu Kato for their support for my internship. Thank you very much.

Sunset From Air Plane's Window

Sunset From Air Plane’s Window


Hello. I am D1 student Oral Kaplan.

During October 9-12, I attended to 2016 IEEE Systems, Man, and Cybernetics conference and presented my work with the title of “In-situ Visualization of Pedaling Forces on Cycling Training Videos”. The conference was held in Budapest, Hungary. There were two hotels designated as conference venues; InterContinental and Sofitel. Unlike all other conferences we focus in our laboratory, this conference governs a much broader spectrum. There is no definitive target, instead it includes Brain-Machine Interface (BMI), Human-Computer Interaction (HCI), Robotics, Software Engineering and many more. Although this situation reduces the overall quality of the works, it creates an environment where people can learn about different research fields to broaden their vision.

I participated in many sessions and I believe in general the conference itself was a quite nice experience. The topics that I listened to included eye tracking, advancements in BMI technologies, pattern recognition and image processing, and many more poster sessions about various topics.

There were multiple keynote speakers but maybe the most important one, the opening keynote, was given by Jose M. Carmena from Helen Wills Neuroscience Institute of UC Berkeley, USA. The topic of his talk was about “Advances in Brain-Machine Interface Systems”. The final part of his speech where he explained wireless capture of brain activity was very interesting.

The best student paper award, which I was interested in, was given to the paper titled as “Automated Brain Tumor Segmentation using Kernel Dictionary Learning and Superpixel-level Features”.

I guess this is enough text and enough explanation. I am leaving you with some pictures that I took during the conference and my trip to Budapest.



My poster presentation


Too bad that not everybody can win


From the keynote of Jose M. Carmena : the future of BMI


Conference banquet : this guy really wanted to eat…


Horse show : how to make a horse sit like a dog


The architectural design of buildings in Budapest was fascinating


A church in Budapest


Royal Palace


A little bit of nightlife


There are many nice coffee shops in Budapest and they also serve lots of delicious food


I had to try the kebab there…

Internship at University of Oulu -First Report-

Hello, I am M1 student Ryoko Kato.
I study abroad at University of Oulu as internship student.

I arrived in Oulu City, on 26th September, and 14 days have already passed.
I can’t believe that… The time just flew by.

In this article, I’d like to describe about my life in Oulu.
First, I will write about my days in University of Oulu.

I am belonging to the group of professor Petri Pulli in Department of Information Processing Science as internship student.
I am a member of the research of the gamification that how technology can support activate isolated young people. Recently, gamification is used many applications and service. Gamification the application of game-design elements(e.g. ranking, badges, and more) and game principles in non-game contexts so as to encourage users of the non-game systemcan continue to use the system.
Now, I’m searching the papers or journals that describe characters of the isolated young people. There are many cases of application, and I think it is interesting.

Secondly, I will write about my days in daily life.

My days in University of Oulu
University of Oulu has extensive lands. There are not only school buildings, but also a botanical garden, and a church in the school site.
In particular, the botanical garden is known as famous tourist site in Oulu City.
I’d like to visit the botanical garden during the my internship.

This photograph shows autumn color of leaves in the campus, I can see the beautiful landscape everyday.


Autumn Leaves

My days in Oulu City
Next, I’d like to write about my life in Oulu City.

Oulu City is little colder than Ikoma, Nara. Therefore I wear the sweater everyday, like winter days in Japan, but it’s not too cold to live:)

I visited several tourist spot on every weekend.

Oulun tuomiokirkko

Oulun tuomiokirkko

Nallikari Beach

Nallikari Beach

Kauppuri 5

Kauppuri 5

I’d like to especially write about the aurora.
Fortunately, I can see the aurora in Oulu City on 4th October’s night.
Following photograph is taken by Kushida-san from Optical Media Interface Laboratory.



The right curtain cover the dark sky, and stars blight on the sky…
“Beautiful”, there is nothing else I can say.

If the weather will be gave me a chance, I would like to take photograph of the aurora by my camera.
In the end of this article, I’d like to thank professor Petri Pulli and IMD professors for their support for my internship.

Kiitos!!(Thank you.)

Report of Visiting Tokyo Institute of Technology

Hello, all.
This is Ryoko Kato, M1 Student.

On 8 July, I visit Professor Sato’s laboratory in Tokyo Institute of technology to presence the technology transfer of SPIDAR-W: SPIDAR-W is a wearable haptic device.
I’d like to thank Professor Sato allowing me to attend the technology transfer.

SPIDAR is haptic interface to give the force feedback to users using motors.
Professor Sato’s laboratory developed SPIDAR-G: users operate a sphere and they can get the force feedback from SPIDAR-G, SPIDAR-MF: users move their fingers attached with strings and they can get the force feedback from SPIDAR-MF, and many haptic devices.
I’d like develop the haptic system using SPIDAR-MF and Augumented Reality on my research.

In this day, Professor Sato and Professor Akahane give me the advice for my research, and I go through a few demonstration of SPIDAR-G.

* Observing students constructing SPIDAR-W
* To Use haptic system using SPIDAR-G
* Watching a video of SPIDAR-G

To use haptic system using SPIDAR-G left an strong impression on me.


Demonstration of SPIDAR-G

Through this opportunity, my motivation towards my research is raise.
However, I felt I should have to learn more wide field of knowledge.

I’d like conclude this article with photograph of a delicious lunch.

Thank you.


School Cafeteria’s Qeema Curry

Ryoko Kato

NARVIS-NAIST Bilateral Workshop on Medical Augmented Reality

Howdy readers! PhD student Damien Constantine Rompapas reporting here!

In late May – Early June, Several of my colleagues and I travelled far to the land of Munich, Germany to participate in the NARVIS-NAIST Bilateral Workshop on Medical Augmented Reality.

The main purpose of this workshop was to nurture collaborations between the Interactive Media Design lab at NAIST and the NARVIS Medical Augmented Reality lab.


The first morning was the first day of presentations, but I arrived earlier to explore TU Munich. The first sight I came across was a massive 4 story slide, making a trip from the 4th floor to the ground floor exciting and fun! (And it certainly was fun to slide in :D).

After that we got a little more serious, and started the presentations, which lasted the first two days.

We heard some amazing research being done by the guys in TU Munich (Which spoke about a range of Medical Applications in Computer Science), as well as some research from our university (Which was more heavy on Augmented Reality), I myself presented my research on EyeAR.

Afterwards we got to enjoy some of the local food (and beer) in Germany. Beginning with a huge leg of

Mmmmm delicious pork leg is delicious

Mmmmm delicious pork leg is delicious

sadly however, I couldn’t finish the huge leg of duck!

Waaah, I couldnt finish it all :c

Waaah, I couldnt finish it all :c

Before heading home, I came across an…. interesting and enticing site!

This statues golden breast is said to give good luck... I SWEAR!

This statues golden breast is said to give good luck… I SWEAR!

In the second day, we heard an interesting talk about Medical Augmented Reality by Professor Nassir! whose lab we visited afterwards. The first place to visit was in the FAR lab, where we saw some cool augmented tabletop Tower Defense games (unfortunately I do not have photos of these). The second place we visited was the Computer Vision and Machine Learning lab! It was here we saw how machine learning can be used to recognize objects in a scene in real-time! (Again, no pictures. sorry!).

Later that evening there was a wine tasting!

*sip sip*  ah,  nothing like a little french wine to end the day.

*sip sip* ah, nothing like a little french wine to end the day.

The third day we took a tour around some of the other TU Munich campuses, and saw many awesome demos! we first visited the NARVIS lab, where we saw a cool combination of Haptics and Augmented Reality for Medical Procedures!

Ok.... carefully insert the pin into the spine... no worries.... This device simulates a live operation on the spines bones.

Ok…. carefully insert the pin into the spine… no worries…. This device simulates a live operation on the spines bones.

We can not see it for ourselves, but Ulrich here is plotting a course for a brain surgeon to cut into the brain avoiding critical parts

We can not see it for ourselves, but Ulrich here is plotting a course for a brain surgeon to cut into the brain avoiding critical parts

After which we had a small lunch break………

There is only one who can handle this much pizza. GIMME!

There is only one who can handle this much pizza. GIMME!

We then took a visit to a Simulation Center for Emergency Medicine, where scenarios are planned and then performed with everything hooked up to a central control room. This allowed the director running the simulation to create interesting scenarios for the medical team to encounter.

(For example, there was a dummy hooked up to some external sensors, which allowed the dummy to become warm/cold, and the monitors hooked up to the dummy produced synthesized heart readings).

The bed actually is hooked up with various network devices to simulate things like a broken wheel!

The bed actually is hooked up with various network devices to simulate things like a broken wheel!


The final day brought us to the IFL lab that’s inside the medical hospital! A lot of weird and exciting demonstrations were shown to us! these were mainly focused on Nuclear and Robotics in medicine!

The robot performs this sonogram all by itself!

The robot performs this sonogram all by itself!


YEOUCH! the poor dummy is used as part of an AR rectal camera simulation for training!

YEOUCH! the poor dummy is used as part of an AR rectal camera simulation for training!

The host family I stayed with enjoyed the evening with a little hand-made Japanese Soy Ramen! (Made by yours truly :P)

I really enjoyed Germany, I wish I could have stayed alot longer.


Signing off.


Rompapas Damien Constantine

PhD Student

Interactive Media Design Laboratory

APMR 2016

Hi, I am Arno, a PhD student of the lab. Professor Sandor, Professor Taketomi and me recently participated at the Asia-Pacific Workshop on Mixed Reality (APMR) in Andong, South Korea. The workshop was from the 22nd to the 24th of February, where during first and last day we had time for some sightseeing around Andong area.

On the first day we visited a historical museum and an old village as well as Korea’s largest pedestrian bridge, the moon light bridge.

The moonlight bridge.

The moonlight bridge.

In the evening we had a nice traditional Korean dinner (including quite strong Korean alcohol)IMG_0019The second day consisted of oral presentations. Notably, Prof. Sandor was asked to give a keynote speech, which he had invested a lot of time in.

Professor Sandor during his keynote speech

Professor Sandor during his keynote speech

I gave a speech as well, however, was a bit nervous. I’ll hope to do better next time.

Me presenting

Me presenting

During the presentations we had a nice lunch at the Hotel …

Lunch at the hotel

Lunch at the hotel

… and at the end there was a poster presentation session

Poster session in the Hotel

Poster session in the Hotel

The two best presentations were about hand gesture recognition (KAIST) and virtual carving (Ritsumeikan University). In general, I felt most research relied on machine learning.

My personal highlight was the Korean Barbecue after the poster session.

Korean Barbecue

Korean Barbecue

The third day was the day of departure. But before that we had the chance to visit Hahoe, a historic Korean village and UNESCO world heritage. Interestingly, people are still living in this village, so that most of the buildings were not publicly available. Also many important figures of Korean history had inhabited this village

Hahoe village

Hahoe village

Our tour guide for Hahoe village

Our tour guide for Hahoe village

All in all it was a great experience for me (also it was the first time I visited Korea) and I am grateful to the lab and NAIST for enabling me to participate in this event, as well as to the organizers for having such nice events. However, I will try my best to have a better presentation and results next time.



IEEE VR 2016

Hi, this is Ryo Akiyama, M1 student.
We participated in IEEE VR 2016 on 19th – 23rd in March.
It was held in Greenville, South Carolina, USA.
In Greenville, it was nice weather and very nice place to stay.

Liberty Bridge(famous bridge in Greenville)

Liberty Bridge(famous bridge in Greenville)

From our lab, Liem and I participated in the conference.
Liem’s poster was on the poster session, and he had short presentation about his poster.

Liem and his poster

Liem and his poster

Liem's presentation

Liem’s presentation

I had a presentation at the workshop, “Perceptual and Cognitive Issues on AR(PERCAR)”.
PERCAR is the workshop about human perception and cognition in augmented reality(AR).
It was my first presentation in conferences, so I was very nervous.
However, some professors told me that I did good job at the presentation.
I think my presentation was not so bad, but my answers to questions from audiences were bad.
I will work more…

Akiyama's presentation

Akiyama’s presentation

Also, Oshima’s paper is accepted to 3DUI, and his poster is on the poster session in IEEE VR.
But he was not there, so Kenny presented about Oshima’s paper in stead.

Kenny's presentation

Kenny’s presentation

As I already mentioned, it was my first time to have presentation in a conference.
I felt that it is difficult to tell about researches to people who don’t know about it.
But it was very good experience, I want to have better presentation and question-and-answer next time.
I will work more to go IEEE VR 2017 in Los Angeles!!

Kati-Sensei and Yamamoto-sensei on the bus

Kato-Sensei and Yamamoto-sensei, on the bus


Thank you Party 2016

Hello, this is Ryo Akiyama, M1 student.
M2 students held “Thank you Party”(謝恩会) for teachers on 16th March.
This party is all planed by M2 students for the teachers.
It was held in Namba, and almost all the IMD members participated in.

First, we enjoyed eating, drinking, and talking freely.
After that, M2 and D3 students had speeches one by one.
Their talk was about grateful feelings for teachers and memories in this lab.

Speech by Jarkko

Speech by Jarkko

Also, Yamamoto-sensei will leave this lab, so he gave us a speech, too.

Speech by Yamamoto-sensei

Speech by Yamamoto-sensei

After the great speeches, graduating students gave presents for four teachers and Ueno-san(secretary of our lab).

Gift for Sandor-sensei

Gift for Sandor-sensei

It was really nice party.
I’m very happy to be a member of this lab.

I cannot imagine most of M2 and D3 students will leave this lab soon.
And, I wonder I can be such a nice student like them next year…
Anyway, congratulations on your graduation!!!
I wish graduating students and Yamamoto-sensei great success at the new place.

Kati-Sensei, Yamamoto-sensei, and M2, D3 students

Kati-Sensei, Yamamoto-sensei, and M2, D3 students

Lab members, in front of the restaurant

Lab members, in front of the restaurant

CEA Workshop in Okinawa

Hello, I am M2 student Seiya Kojima.
We participated to a domestic workshop named Multimedia on Cooking and Eating Activities (CEA) on 7th-8th in March.

It was held in Nago City of Okinawa Prefecture.
Once more, Okinawa!
It was warm and comfy in Okinawa and I made a good presentation thanks to the climate.

2016-03-07 14.38.28

Hibiscuses were in blooming.

About the workshop, it was organised by four technnology committees and four different workshops were held at the same time.
The co-organizers were
1. Multimedia and Virtual Environment (MVE)
2. Image Engineering (IE)
3. Image Media Quality (IMQ)
4. Communication Quality (CQ)

On campus of Meio University, the venue of workshop

On campus of Meio University, the venue of workshop.

I presented our research in CEA that was jointly hosted with MVE.
I am going to introduce our research first because some of you might think why Cooking and Eating Activities?
We are focusing on a diet therapy for patients with chronic kidney disease.
We analyzed nutritional data from diets for patients by using KNApSAcK Family Database and developed menu planning support method and evaluated its effectiveness.
In our laboratory, we are using not only AR or VR technologies, but also some other technologies for interaction design reseach.
I am studying this topic in cooperation with Computational Systems Biology Laboratory in NAIST and Faculty of Agriculture in Kinki University and trying to develop a beneficial system.

My presentation title slide

My presentation title slide.

About workshop, there were some research presentations I was interested in.
The research which introduced a novel method to present virtual food texture by using electrical muscle stimulation to the muscles of mastication was interesting because the technology might be able to increase the level of satisfaction that people get from eating.
There were many other research for cooking and eating activities such as automatic calorie estimation from food images and changing the taste of beverages by modifying their saturation.
I saw massive potential in using information technologies for eating activities.


Lunch with professors of our research project.

I discussed with professors and students from other universities in a social gathering.
I am very thankful to all professors whom took me to this workshop.

We enjoyed eating tuna at social gathering.

We enjoyed eating tuna at social gathering.