Author Archives: imd-lab

MIRU 2018

Hello everyone.
I’m Ryo Akiyama, D2 student.

I participated in MIRU 2018 @Sapporo on August 5th to 8th. MIRU (Meeting on Image Recognition and Understanding) is one of the largest conference about computer vision in Japan.






I had poster presentation this time. The title is “Expanding perceptual color range of a projector by inducing color constancy (色恒常性を利用したプロジェクタの色域の知覚的拡張).” In MIRU, all the presenters (even invited speakers) need to have poster presentation. In other words, we can meet all the presenters at the poster presentation room. I don’t know this is the reason, but many participants were discussing with presenters at poster room and they look very active.

Of course, I also discussed with many people about my research. And I got “Interactive Presentation Award.” This is a kind of “best poster award”, and 7 presentation (from 224!!) got this award. I am very glad to have this award, and I feel thank to my supervisors who support me a lot.

I conclude this post with some photos.
Thank you for reading.


poster presentation









when I got the award

people in Hokkaido eat a parfait after drinking


Hello, I’m Haruka Matsumura, in our laboratory’s event organizer committee.
In early May, we held Welcome Party for new M1 students who entranced in this year April.
(My post was so delayed X( )

In this time, we have 6 new Japanese students joining our lab, and also 2 research students in our lab becoming new M1.
So, we have 8 new M1 students now.
We’re happy coming many new students!

Group Photo

Visit to Mississippi State University

Hello everyone!

This is Jayzon Ty, an M2 student, and welcome to my first blog post!

Last February 12 to March 16. I was at the Center for Advanced Vehicular Systems (CAVS) in Mississippi State University (MSU).

Center for Advanced Vehicular Systems Building

While there, I was working under the lab of Dr. J. Edward Swan II, who specializes in human factors of virtual and augmented reality, particularly in depth and layout perception. The lab is relatively small compared to the IMD lab, in terms of size of room and number of people, but this creates a very warm atmosphere where everyone is really close with each other.

Inside Dr. Swan’s lab

Photo with some members of the lab. Unfortunately, I did not have a proper photo with everyone in the lab itself, so here’s a photo of us eating two giant pizzas.

During my stay, I helped Dr. Swan with the SharpView project. In a nutshell, SharpView is a method for counteracting image blurring when viewing an image out of focus, i.e. “sharpening” it. I worked on implementing features that Dr. Swan wants to add to SharpView, as well as investigating other approaches for the “sharpening” part. In the process, I got to work with the haploscope, an AR display that can display virtual objects in different focal distances by changing the lenses in the system. I also worked with the SMI Eye tracker, a very expensive eye-tracker that is worn like eyeglasses (which I don’t have a picture of, unfortunately).

The haploscope, an AR display capable of displaying virtual contents at different focal distances.

As they say, everything in the US is big, and Mississippi State University is no exception. The campus is so big that it has its own lake, and as well as a lot of sports stadiums. In order to get to the lab from my dormitory, I can take a bus, or I can take a 30-minute walk along the scenic route. I almost always choose the latter.

Walking path to the lab

In-campus lake

Basketball Stadium

Butler Hall, Computer Science Department

I also had the opportunity to attend a women’s basketball match, thanks to Dr. Swan. Apparently, the women’s team was undefeated at the time, and *spoilers*, they retained their undefeated streak in this match.

Mississippi State University versus Texas A&M

The team won the match, maintaining their 28-win streak for the season!

Speaking of big, here is a photo of a burger that I ate one time. Note the size of the onion rings with respect to the burger.

Bulldog Burger with Onion Rings

Unfortunately, public transportation was a bit lacking, so I was not able to go to a lot of places outside of campus. All in all, I could say that I managed to go to three major places outside of campus.

The first one is the town of Starkville, where MSU is located. This area in particular is around a 15 minute drive from campus. The town has a very chill atmosphere, which I really liked. We often go here for lunch, and sometimes for dinner as well.


Fun fact: Dr. Swan is a computer scientist by day, and a musician by night, so he goes to a lot of places to perform with his band, the “Shane Tubbs Band”, as their bassist (I really want to learn the bass sometime). So, for my second major trip, we went to the town of Westpoint, where Dr. Swan and his band performed in a music festival, which served as a fundraiser event for the treatment of a person with cancer. Funnily enough, the event venue is in a farm in the middle of nowhere.

Dr. Swan and another kid playing with an anthill. Poor ants.

Dr. Swan (while talking to the kid): Do you know what cows are made of? Hamburgers!

Dr. Swan performing with his band at the music festival. Unfortunately, I wasn’t able to take a closer photo.

The last major trip was a trip to another state, Atlanta, which was a 4 hour drive from the campus. One of the students in the lab needed to get a German visa in order to attend IEEE VR 2018, so I went with him to Atlanta, where the German embassy was located. We left campus at 3am, and arrived at around 8am (+1 hour difference).

As we were heading home, we also passed by the University of Alabama. Same as MSU, the campus was also very big.

Football stadium in University of Alabama

Unfortunately, all good things must come to an end, so before I went back to Japan, we had a farewell dinner at a restaurant in Starkville. The food was so big that I wasn’t able to finish it, and I had to get a take out box so I could eat it for lunch the next day.

The picture makes it look small, but the chicken is actually really big, probably around 3/4 the size of an HTC Vive.

Farewell dinner with Dr. Swan and some of his students. They flew for IEEE VR 2018 the next day.

On the way back to Japan, I had a layover in Incheon International Airport in Seoul. I happened to find this demo inside the airport: VR Flying. Unfortunately, I was already too tired at this point, so I did not give it a try. Maybe we should have a similar setup in the lab?

VR Flying demo inside Incheon International Airport

Overall, I really enjoyed working with Dr. Swan and his students, as well as the experience of being in the US. I really learned a lot in this experience. This trip also introduced a lot of first’s for me, e.g. first trip to the US, first 15~ hour flight, first jet lag experience, first trip to South Korea (even though it’s only a layover), and more. If you ever get the chance to go to MSU and work with Dr. Swan, I highly recommend going for it!

Finally, I would like to thank the Interactive Media Design laboratory, especially Dr. Alexander Plopski who organized this trip, and Dr. Edward Swan for making this experience possible. I would also like to thank Dr. Swan’s students, as well as his wife, Mrs. Courtney Swan, for making my stay in Mississippi a very enjoyable and memorable one. Until we meet again!

IEEE VR 2018 (Akiyama)

Hello, I’m Ryo Akiyama, D2 student.
I attended to IEEE VR 2018 in Reutlingen, Germany (March 18th ~ 22nd).
It was very cold, and snow still remained in the city.

Welcome to IEEE VR 2018 !


Stadthalle Reutlingen

From IMD lab, Oral, Nicko, and I attended this year. Oral and I had poster presentation, and Nicko had conference paper presentation. Nicko presented his work about comparing efficiency of AR and VR environments for memorizing spatial position. Oral presented his work about visualizing knee movement for supporting bicycle training with less risk of injury.

Nicko’s presentation


Oral’s fast forward presentation

I presented about light projection technology to control object color by inducing visual illusion. Projectors only can add colors to real objects by overlaying light projection. However, when the object is not white, only a limited colors can be presented by projection. Our project want to overcome this limitation by inducing one of the visual illusion, color constancy. I presented current results with my poster. Many people more than I expected came to my poster. I had many discussion with them. It was great time for me to know many opinions or questions.

The largest number of participants ever!

IEEE VR 2019 in Osaka, Japan.

Next year, IEEE VR 2019 will be held in Osaka, Japan. Nowadays, AR and VR have became very popular in many field. I expect many participants more than this year come to IEEE VR in Osaka.

IEEE VR 2018

My name is Nicko Caluya, and welcome to my first blog entry here. I am an M2 student.

Last week (March 18-22), I attended IEEE VR 2018 with labmates and professors at Stadthalle Reutlingen, at the southern part of Germany.

Stadthalle at night, all bright and colorful

Since we attended the full conference, we sat through two days of workshops, and three days of the main conference. I would like to point out some highlights from each day.

Prof. Swan’s Presentation

On the first day, I attended a tutorial session by Professor J. Edward Swan II regarding the statistics and the replication crisis. In the afternoon, I filled in the latter half of the day with a displays tutorial, where speakers talked about High Dynamic Range (HDR) and gaze-aware displays. I hopped my way through second workshop day, going from the calibration tutorial in the morning, to a tutorial in Web 3D in the early afternoon, to the last session on a workshop on perceptual and cognitive issues in AR.

Oral trying out the demo at the displays tutorial

Aside from attending the conferences, we had the chance to visit two institutes. On the second workshop day, we rode the bus to the Fraunhofer Institute at Stuttgart. The researchers took us to the Hazel Hen (a high performance computing system with peak performance of 7.42 PFlops), to an awesome CAVE (cave automatic virtual environment), to an actual (stationary) car for a driving simulator, among many awesome demonstrations. I took a picture of us wearing the glasses in the CAVE, and I can say we can definitely form a cool boy band!

The new boy band from IMD

The day after, we toured the Max Planck Institute at Tübingen to see giant rooms housing a VR CyberMotion Simulator and a cable robot where you can be suspended inside an icosahedron.

I was with Oral and Akiyama, who delivered their poster presentations on the first and second days of the main conference, respectively. Many professors and students from different universities in Japan also attended the conference. Immediately, I was already excited at the prospect of meeting people behind the cited works from our lab meetings or lessons. These names will finally have faces and characters!

Akiyama explaining his projection work 

While this was not my first time for attending a conference, I was still amazed at all the new wonderful things I have learned from the presentations. Veterans from both the academe and the industry presented their keynote presentations as if they have rehearsed all their lives for their own moments. What made me entertained so much was this keynote Dr.-Ing. Oliver Riedel, presenting the 25 years of VR in industry as an Einstein look-alike.

Dr.-Ing. Riedel’s presentation

For me, the term “virtual reality” is already such a huge domain, and I believe that the conference made me realize just how much bigger it is. For example, results from “Avatars and Virtual Humans” session used statistical treatments for within- and between-subjects studies, primarily because they deal with human perception. In another, the papers from the rendering session offer various computer graphics techniques and hardware configurations to make specific VR experiences better. And of course, the multimodality session showcased papers which featured the VR of the other senses (sound, smell, touch) which often gets overlooked by the bias of VR research towards sight. Many paper presentations amused me across all sessions. Some presentations had slides designed very elegantly. Some carried me away with either the storytelling or the amount of data they were able to analyze on one study alone.

On the final day, I presented first on a session about “Selection and Pointing”. I was surprised to hear someone say “That’s our paper!” when I was scrolling through my slides to check if the presentation worked correctly. I presented our work on comparing AR and VR environments, to see which of the two can efficiently transfer the skill of memorizing locations of objects from training to the actual scenario. During the presentation itself, I was quite nervous, but not because of the size of the screen behind me or the big hall aptly named “Grosser Saal”. I was nervous to go over the time limit and not say what I need to say. So, it was a really nice feeling to finish the presentation on time, with enough time to answer two short questions. In the afternoon, I was even able to try out a demo by Daimler, riding on a Mercedes Benz passenger seat in the snowy streets of Reutlingen.

My presentation. I am so tiny compared to the screen!

As a person who cherishes the first times, it was definitely a great experience to showcase my first research work as a first author, on my first big conference as a graduate student, on my first time in a European country (the farthest I have traveled so far – 17 hours, 9000+ kilometers!). It felt like the whole process of getting there – from conducting the experiment, to writing and violently revising the paper, to preparing all the necessary paperwork to enter Germany and attend the conference – was such a humbling experience. I would like to take this opportunity to thank everyone who made it possible for me to go through all this without fainting. Thank you most especially to Alex-sensei and Jayzon for sticking out with me in order to get the paper done. Thank you to IMD faculty and students who shared valuable comments as I showed my progress and rehearsed my presentation before leaving.

Oh, and Germany was nice, except that the weather did not cooperate (sunny in the morning, snowy in the afternoon). I had so much fun… drinking lots of beer and eating lots of bread (and schnitzel, and kebabs, and currywurst… the list goes on).

Turkish food are popular in Germany; they have a shop at almost every street corner

Tübinger Tor (the structure you see in IEEE VR 2018 logo) on a snowy afternoon

Currywurst and fries at Frankfurt Station before leaving

From now on, I am more determined to continue with my research and publish better works, with more drive and with a broader source of ideas. As I have found out from the closing ceremony, IEEE VR will be in Osaka. I hope I can participate and present again.

For now, stay tuned. To be continued. 「つづく」

IEEE VR 2018

Hi. D2 Oral is here.

From March 17th to 22nd, we visited Reutlingen in Germany to participate IEEE VR 2018. Me and Akiyama had a poster presentation and Nicko introduced his work in the form of a conference paper.  Overall I believe it was a valuable experience for all of us to learn about new technologies and create connections with researchers from all around the world.

The conference took place in Stadthalle Reutlingen for a total of five days; two for workshops and tutorials, three for the actual conference. Although the name of the conference is VR, it included research focusing on MR, AR, haptics or distinct interaction technologies. I was mostly interested in “Tutorial on Cutting-Edge VR/AR Display Technologies” due to its focus on “Motion-Aware Displays”.

As always, I will cut it short and let pictures do the talking about this episode of my studies. Detailed info on conference and awards given will probably be shared by my colleagues anyways… 😉


Stadthalle Reutlingen

You can always learn new laws

Spätzle and Weissbier

You can always listen an acquaintance’s presentation

Super computer at Max Planck Institute

Somebody is doing cycling research?

A nice work on tactile cues

Nicko’s presentation



Internship at University of Oulu

I’m Shuichi Otani,M1 student.I’ve finished one month internship at University of Oulu,and came back last week. I would like to make a report on it.

First of all, I’ll report about contents I tackled at the University of Oulu.In this internship, I belonged to Tapio Seppanen and Professor Tiina Seppanen ‘s Physiological Signal Analysis Group in CMVS (The Center for Machine Vision and Signal Analysis).I analyzed data of Respiratory Effort Belts which is the research theme of Professor Tiina.The reason for choosing this theme is that it is in common with my research at NAIST in terms of fusion of information technology and medicine, so I thought there might be something that could be applied to my research.

Prof.Tiina with me

Respiratory Effort Belts can estimate various information on breathing, such as pace of respiration, flow rate, etc., from chest and belly movements.In this internship, I analyzed the relationship between the accurate value measured by spirometer and the estimated value measured by Respiratory Effort Belts.The data used for the analysis is what measured real allergic patients at the hospital, and treating such data was a very valuable experience.


I used software called SPSS for analysis. It was my first time for using that software, so I had a difficulty at the beginning.Thanks of the roommates’ help, I finally managed to submit results to Professor Tiina somehow.
This internship gained me new knowledge and it was also a good opportunity to deepen understanding of my research.


Next I will write about Finland.
First of all, it was so cold anyhow. It fell to a minimum of -23 ℃ during my stay.

However, except for the low temperature, the life in Finland was very comfortable and wonderful.
The streets are beautiful, the food is delicious, there is also a shopping center near the hotel, which made my life like I spend in Japan.

Pictures in Oulu city

Also I met Ilyas who had been an internship at IMD lab last year.
I had a really good time with him during this internship. At the last weekend he took me to Kemi’s Snow Castle. Thanks of him it has been a very pleasant internship.

Pictures with Ilyas

Although it was a short period, I had a valuable experience. I would like to engage in research by taking advantage of experience in Oulu.
Finally, I would like to thank to the professors of University of Oulu and the Interactive Media Design Laboratory who supported me in this internship.

Kiitos !!

ISCA 2017

Hello, I’m Yuto Inamitsu, M2 student.

happy New Year.
This is the first post in 2018.
Did everyone have a good New Year?

Speaking of New Year, dreams seen from January 1st to 2nd are called first dreams.
I am born and have never seen the first dream, but I am hoping that I can see the first dream this year tonight.

Aside from that, I’d like to report about attending to ISCA 2017 held at the Grand front Osaka Knowledge Capital Event Lab on December 1 and 2.

ISCA (INTERNATIONAL STUDENTS CREATIVE AWARD) is an international creative award for students from universities, graduate schools and vocational schools both in Japan and overseas.

There are three categories, “Domestic Video Content Section”, “Overseas Video Content Section” and “Digital Content Section”.

When I submitted my own research “AR Yōkai: A Situated Augmented Reality Ghost Story” at the “Digital Content Division”, it was selected as a nomination work for this examination, and it came in with the carrying of the exhibition.

On the first day of the event, there was a review of nominated works by various jury members and an announcement of winning works.

On the day, I also made presentations of my work before the judges, I became nervous.

I was thinking “Would it be possible to win the prize?” while I participated in the award presentation, but my work was selected as an excellent prize!

This time’s excellent prize was not gained by my own power, it was the result that I could accomplish thanks to everyone who cooperated in this research.

I would like to take this opportunity to thank you! Thank you very much!

Also, the judges received encouraging words.

I am pleased to have an honorable prize!

After the ceremony, work screenings of “Domestic Video Content Section” and “Overseas Video Content Section” were held.
I’m taking storytelling as the theme of my research.
So I was impressed with quality quite contradictory to which work is not professional work, it was skillful to tell the story clearly, the beauty of the image, the cleverness of the production.

Also in the “Digital Content Division”, an application called “Mitugibako”, in which a smartphone Novell game scenario is unlocked at the same time as saving money, by linking a piggy bank with a smartphone app.
It was so unique.
And information on dead people worldwide to the virtual earth There are many impressive works, such as media art such as “Leaves” to display on infographics on top, and it inspired my own desire for creation.

Unlike my field, it is not surprising that people who regret their talent are gathering and presenting their works.
This time ISCA2017 has become an invaluable experience for ourselves.

In order not to be ashamed of the result of this time, I will try my best to work harder.

ACE 2017 at London

Hello everyone.

D2 Oral Kaplan is here.

I was in London from December 14th to 16th to take part in this year’s Advancements in Computer Entertainment (ACE) conference. Aside from presenting my own ideas on improving exercise motivation, I was also the chair of session two. I have to admit, it was a very pleasant experience which allows one to grow professionally. Couldn’t be happier! 🙂

The overall quality of presentations were quite high; some being highly intuitive in presentation style and others with quite interesting topics. In general, I believe I learned new things that I can hopefully utilize for my own research goals.

Below you can see a couple of photos taken by me or the professors who accompanied me to one of the most beautiful cities in Europe. Please enjoy, and let’s do our best together to make this world a better place for everyone.


Just before the glorious Tower Bridge…

Facing the glorious Tower Bridge

one of the glorious towers of the glorious Tower Bridge!

conference venue; The Shard, as viewed from far

when they raise the bridge

Buckingham Palace

found a plate that looks like me

The Amazing Chairman!

The Amazing Chairman! cannot say your school’s name!

During my presentation

Library of the Royal Institution

Library of the Royal Institution

Library of the Royal Institution

Sometimes your professor might act distant…

…but actually he is very close to you…

…and closer, closer, and closer. 🙂

ICAT-EGVE’2017 at Adelaide, Australia

Hello, everyone.
I’m Haruka Matsumura, an M1 student.

Last week, I and Taketomi-sensei went to Adelaide in Australia and we attended ICAT-EGVE’2017.
This was first time trip to the foreign country for me.
I felt Adelaide is nice townscape and scotch steak is very delicious.

The conference’s keynote talk was “Small, Lightweight and Fast: A Near Future of On-the-go AR and Wearables”. The speaker is Professor Thad Starner.
He is a wearable computing pioneer, a Professor of Computing at Georgia Tech and a Technical Lead on Google Glass.
We could listen to interesting talk about current and future of AR and wearable.

Keynote talk by Prof. Thad Starner

In oral presentations, there was the sum of 33 presentations (full paper and short paper) in 8 sessions.
The study related to “Eyes” won awards of best full paper and best short paper.


Taketomi-sensei explaining his poster

In poster presentations, there were 17 posters, and I and Taketomi-sensei presented.
It’s a study of using AR for a practice of athletes in a sport.
I could receive several pieces of advice and some comments like “It’s an interesting study” from people, so I’m happy.
But, unfortunately, I spoke haltingly and explanation was a few words…
I strongly think I have to more learn English to good communication.

Me explaining the poster


The banquet venue

In the banquet, we had went to winery and I could purchase a wine by discount as souvenir for my family.
The next conference will be held in Limassol, Cyprus.

I think this trip was a good experience for me.