UU直播

Ziheng Liang, Xiaoyu Yan, Professor Steve Engels, Ami Powell and Chratien Mak (photo by Nina Haikara)

What they did on their summer vacation: from virtual underwater exploration to a statue that tweets

Meet the computer science undergrads who volunteered to develop technology-based exhibits for the ROM

Whether they spent their summers working, taking courses or traveling the globe, UU直播 students had many options available to them before heading back to campus this fall. 

One group of computer science students was invited by Steve Engels, , to join him in an extra-curricular initiative: developing demo technology exhibits for the Royal Ontario Museum (ROM).

鈥淲e鈥檙e developing exhibits of the future,鈥 said Engels. 鈥淎s computer scientists, we鈥檙e continually exposed to new technology. We want to show the ROM what museums are capable of.鈥 

Two years ago, Engels supported a group of students interested in undertaking a volunteer project with the Royal Ontario Museum (ROM) to design interactive video games for the museum's ancient cultures exhibit.

This summer, a group of seven undergraduate students in computer science made use of cool tech toys and their programming skills to showcase what is possible when you leverage the latest in technology. 

鈥淢useums have long used technology to enhance the visitor experience,鈥 said Cheryl Fraser, manager of the ROM鈥檚 web and social media presence. 鈥淭hrough partnerships such as this one with the department of computer science, ROM has a unique opportunity to develop new ideas and test how the newest technologies can be used in our galleries.鈥 

A mobile application to wayfind your next exhibit 

Third-year undergraduates Ziheng Liang and Xiaoyu Yan developed a tour guide application that tracks visitor progress through the ROM and makes suggestions. Guests can also tag which displays they missed, to ensure repeat returns. 

鈥淭he ROM is a huge museum, it鈥檚 easy to get lost,鈥 says Yan. 鈥淵ou can use the 鈥榳here am I鈥 function and find your way to the next exhibit. You can also check how many galleries there are on each floor, view gallery lists, or search for what you want to see.鈥 

The museum鈥檚 many activities can also be posted to the app and the developers are planning a voice introduction to each exhibit space.

Prehistoric underwater adventure

Third-year undergraduates Chratien Mak and Amy Xiao thought visitors would like to experience the biodiversity exhibit firsthand. Using Oculus virtual reality goggles, the user dives in, hands outstretched and can see themselves in virtual form navigating the waters.

鈥淲e鈥檙e also developing a 3D model of an arthropod, its fossil recently found in the Marble Canyon site of the Burgess Shale, that is believed to have existed 508 million years ago,鈥 Mak says, to accompany the virtual underwater experience. 

(.)

Dress-up in another century 

Ami Powell and Gabriel Bussieres made use of an Xbox Kinect to expand the children鈥檚 costume area and extend visitor play to any part of the ROM. 

鈥淭he kids section has a few costumes children can try on, but only in children鈥檚 sizes,鈥 says Powell, a fourth-year undergraduate. 鈥淲ith use of an Xbox Kinect we鈥檙e programming ways people could virtually try on different historical garments 鈥 all sizes, more options, and no hygiene problems.鈥 

鈥淵ou鈥檒l be able to change your background 鈥 so if there鈥檚 a new exhibit at the ROM, they鈥檒l be able to promote it,鈥 says collaborator Bussieres, a third-year undergraduate. 鈥淵ou鈥檒l also be able to save your picture and send it out to social media 鈥 which also promotes the ROM.鈥 

The Xbox Kinect the students are currently using can display up to two people, but an upgraded version would allow up to six visitors to play virtual dress-up in a single scene.  

Social behavior from an ancient world

Have you ever rubbed the left foot of the statue of Timothy Eaton at the ROM? (Apparently the gesture brings you good luck.) And if you tweeted it, maybe Eaton would like to thank you. Fourth-year student Adamo Carolli experimented with machine learning knowledge to send replies back to visitors.    

鈥淪teve and I joked 鈥榳ouldn鈥檛 be cool if the exhibits had their own Twitter account,鈥 so we decided to give a voice to the exhibits,鈥 says Carolli, a fourth-year undergraduate. 

鈥淭here are patterns in how people discuss the exhibit 鈥撯楻ubbed Mr. Eaton鈥檚 foot鈥 鈥 and maybe they鈥檒l post a picture. Our artificial intelligence bot scan through all the tweets that come out on Twitter and it looks for these patterns. Once it finds these patterns, it sends a tweet back to the user 鈥 as the foot 鈥 thanking them and wishing them luck.鈥 

Carolli sees further opportunity for the exhibits to also tweet one another. 

This summer鈥檚 initiative with the ROM was voluntary and not for course credit. Each student signed up for the opportunity to learn and gain further experience outside their program. 

鈥淭o create and demonstrate real-life practice is invaluable, and to innovate for a globally recognized museum and cultural leader like the ROM, is truly unique,鈥 said Engels. 

The students presented final demos of all four projects to the ROM鈥檚 senior executive on August 25.  

Nina Haikara is a writer with the department of computer science. 

The Bulletin Brief logo

Subscribe to The Bulletin Brief