Musical Experiments Inspire New Video Game Music Ensemble
Image by Tess McCumber
06/07/2022
By Katharine Webster
Sound recording technology (SRT) major Tess McCumber 鈥�22 grew up playing Pok茅mon games on her Nintendo DS, and then also became obsessed with the massively popular game Minecraft.聽
So when she heard that students in the Music Department鈥檚 Contemporary Electronic Ensemble, led by Assoc. Teaching Prof. Ramon Castillo, were creating music videos using Minecraft, she joined up.聽
She says the practical experience of synchronizing sounds to video games built on what she had learned in classes required for her major 鈥� and gave her a better understanding of electric circuits that will help her in her new career as a sound technician at AudioLink, a company that provides voiceover recording and production services.聽
鈥淲e had to take electrical engineering courses about sound technology, but I didn鈥檛 really understand circuitry until we did this hands-on project in Minecraft,鈥� McCumber says. 鈥淪eeing it visually, seeing how wiring and electronics and machines work, was the biggest takeaway.鈥�
Image by Ramon Castillo
鈥淟avender Town鈥� was among 18 51视频 projects featured at the all-video, , which drew participants from around the world. While most create their own instruments, both analog and electronic, organizer Sherry Huss was happy to accept digital performances this year because the festival was virtual, due to the COVID-19 pandemic.
Castillo encouraged students in his Contemporary Electronic Ensemble class to participate in the festival, which debuted the weekend of May 14-15. Nearly a dozen students did, and Castillo ended up organizing . He spoke about several of the projects in a real-time session during the festival, and he will speak and perform live at聽聽hackers' conference in New York City in July, as well.
In addition to the Minecraft videos, the UML building at the Maker Music Festival features a video about the , a pair of live performances on original or reconstructed instruments, and two video projects by students from Prof. Gena Greher鈥檚 Technology in Music Education class, as well as several of Castillo鈥檚 original compositions and collaborations with his 8-year-old daughter, Luna.聽
Four of the UML projects won awards at the festival, including 鈥淟avender Town鈥� and the .
Image by Kyle Kashiwabara and Matt Makuc
Castillo was also inspired by his daughter, who plays the educational, multiplayer version of Minecraft, and the depth of electronic music possibilities the game offers.
鈥淵ou could see the other person and interact with them in real time, and that鈥檚 exactly what we lost during remote learning,鈥� Castillo says. 鈥淪o using Minecraft in the ensemble seemed like a way we could get that back, at least to a degree. Every project the students created had to have an element of live performance, too.鈥�
The took place at the end of every semester on the social media platform Twitch.
Castillo had already begun some musical Minecraft experiments of his own, a group of works he calls In chickens, villagers and cows fall from different heights onto virtual pressure plates that respond to their 鈥渨eight鈥� by triggering in-game sounds and actions, via circuits constructed of 鈥渞edstone,鈥� an electrically conductive element within the game.聽
Image by Tristan Fruzzetti
Vocal performance major Kyle Kashiwabara and composition for new media major Matt Makuc used stop-motion animation in another award winner, to simulate a motorcycle traveling along a road. As it travels, it activates layers of redstone-connected sound and command blocks. (Command blocks contain a line of code that can make a more complex sound or prompt another action within the game.)
Some students created both visual and musical accompaniments to live performance. In which also won an award, SRT major Tristan Fruzzetti created a video with an audio track and visuals from Minecraft and Logic digital recording software to accompany his solo performance on electric guitar.
The Minecraft musical projects have proved so popular that Castillo is starting a new ensemble in the fall, the Video Game Ensemble. The Music Department is funding a dedicated Minecraft server that Castillo and his students can use and modify. Castillo has already built a virtual replica of UML鈥檚 Durgin Hall inside it.
A good friend of Castillo鈥檚, Alex Rigopulos, the co-founder and creative director of Harmonix Music Systems who helped design the original Guitar Hero and Rock Band games, has made a generous donation to fund some add-ons and other technology for the new ensemble.
Image by Ryan Katz
Ryan Katz, an SRT major and rising senior who has played in the ensemble for four semesters, stuck with creating and adapting electronic instruments and sound banks during the pandemic, rather than migrating to Minecraft.
One of his videos in the 2022 Maker Music Festival, features a live, improvised piece he performed with two friends, using a Yamaha keyboard he鈥檇 rewired to create new sounds, a practice known as 鈥渃ircuit bending.鈥�
His other video features an instrument he invented to respond to the weather, using sensors that measure atmospheric and ground conditions including light, temperature and soil moisture. A human player adds more chaotic and percussive sounds by manipulating a joystick, knob and trackpad.
Although 鈥淭he Meteorologist鈥� starts by playing a simple chord progression, it never plays the same piece twice, Katz says, because it responds to the weather and human touch at that time and location.
鈥淚 wanted an intersection between what we've created and what the environment creates,鈥� he says.
