Impromptu Jam is a research project sponsored by Verizon Connected Features and made in collaboration with NYC Media Lab and musician Corey Bertelsen. The goal of the research was to find creative use cases for multiuser augmented reality.

Impromptu Jam empowers non-musicians to participate in an audio-visual augmented reality jam session.

Each hue is an instrument, each shade is a pitch. With a few taps on your screen, Impromptu Jam lets players use the colors of your surroundings to make rhythms, visualized as bouncing balls. Two people can join up over a network to jam together.

NYC Media Lab summit presentation:

Additionally, while making this project, we explored synesthetic modes of interaction and how sounds translate to color for  people with different backgrounds.