Portfolio Categories: XR

Real-time visuals R&D

Real-time visual R&D During the year we explored music visualization and synthesis for XR, Unity -- Houdini VFX pipelines, compute shaders, biosimulation and artificial life, new Unity VFX graph workflows and many more! All runs in real-time, most was done for VR! [cl_column_inner width="1/2"][cl_column_inner width="1/2"][cl_column_inner width="1/2"][cl_column_inner width="1/2"]
Continue Reading

Impromptu Jam

synesthetic multiuser music jam in augmented reality Impromptu Jam is a research project sponsored by Verizon Connected Features and made in collaboration with NYC Media Lab and musician Corey Bertelsen. The goal of the research was to find creative use cases for multiuser augmented reality. Impromptu Jam empowers non-musicians to participate in an audio-visual augmented reality jam session. Each hue is an instrument, each shade is a pitch. With a few taps on your screen, Impromptu Jam lets players use the colors of your surroundings to make rhythms, visualized as bouncing balls. Two people can join up over a network to jam together. NYC Media Lab summit presentation: Additionally, while making this project, we explored synesthetic modes of interaction and how sounds translate to color for  people with different backgrounds. [cl_column_inner width="1/2"][cl_column_inner width="1/2"]
Continue Reading

Bumblebee Jam for Bose AR

Bumblebee Jam for Bose AR [cl_column_inner width="1/4"] Client:  Bose, developed in collaboration with Playcrafting Team: Gordey Chernyy: songs, programming Maria Mishurenko: programming, game design Carol Mertz: UI design, voice acting Sevan Mujukian: songs and sounds [cl_media image="id:1010|url:https%253A%252F%252Fsynestheticecho.com%252Fwp-content%252Fuploads%252F2020%252F02%252FAPPLE.png" custom_link="https://apps.apple.com/us/app/bumblebee-jam/id1485176964"][cl_media image="id:1011|url:https%253A%252F%252Fsynestheticecho.com%252Fwp-content%252Fuploads%252F2020%252F02%252FGOOGLEPLAy.png" custom_link="https://play.google.com/store/apps/details?id=com.SynestheticEcho.BumbleBeeJam"] Links:Variety press releaseBusiness insider press releaseNYC Bose Game Jam video [cl_column_inner width="3/4"] Bumblebee Jam is an explorative choose-your-own-adventure musical experience played exclusively with Bose AR devices. Layer song loops, set in a world where flowers produce music. Listen, explore, and nod along to the music, collecting song loops like pollen to blossom a musical garden. Using your Bose AR device, look around to find new sounds, nodding your head along to the beat when you find one you like. Explore as long as you want, discovering countless ways of layering together song tracks. This game is an audio-first experience designed for Bose AR devices (Bose Frames, Quiet Comfort 35 II and N700 series headphones). You don’t need to look at [...]
Continue Reading

Action Spectra

Action Spectra is an accessible, social, bite-sized VR fitness adventures set up in a unique and ever-changing universe It is a game, a service, a social network and a creative outlet all rolled into one app. It revolutionizes the way people think about movement. Action Spectra is not a full replacement of fitness routine (yet), but it’s a novel, engaging way to regularly enjoy exercise, meditation and build healthy habits. Currently in development. [cl_column_inner width="1/3"] EVERY ACTION MATTERS When you buy the app and create an account, you are being assigned a piece of land on the remote planet. There is nothing there, except unlimited potential, as you create a complex ecosystem from scratch. You become the Spectral Guardian, the sole source of energy in this world with every exercise performed affecting the world you created. You will grow forests from seeds, defeat evil and nurture life. If you neglect your ecosystem by not returning to the game, it will decay [...]
Continue Reading

Finist Painter

Finist Painter: Looking Glass Edition collaborative framework for XR art creation OverviewFinist Painter: Looking Glass edition is an artistic framework that allows two users to collaborate using VR and Looking Glass with Leap Motion at the same time. If you want to dive deep into the development process, use cases and the inspiration behind the project, read our large Medium blogpost  [cl_column_inner width="2/3"]what is looking glassLooking Glass is a patent-pending combination of lightfield and volumetric display technologies within a single three-dimensional display system. 45 unique simultaneous views of a virtual scene are captured on a computer at 60 frames per second.The Looking Glass always seemed incredibly interesting for us as user experience (UX) researchers, developers and designers. We've been following Looking Glass Factory for a while, since they first launched their volumetric display prototype (Volume) back in 2015. This year, the Looking Glass finally became a small, versatile and truly magical fish tank with a handy Unity SDK. At Synesthetic [...]
Continue Reading

Bizarre Barber

Bizarre Barber - action arcade for VR Bizarre Barber is a fast-paced VR action game for Oculus Rift set in a surreal world where you play as an alien barber providing stylish haircuts for eccentric clientele. Instead of a comfy adjustable chair you’d see in most barber shops, all of your clients move chaotically through the world unable to sit still even for a second. Players will make perfect cuts, dodge dangerous obstacles, catch speed boosts and power-ups, and even earn money to unlock new tools and new worlds. Can you keep up with the bizarre styling trends and hyperactive pace of this surreal metropolis?Bizarre Barber is a grant winner for Oculus Launchpad 2018 program. Development is supported by Oculus. FOR YOUR TEENAGER AND YOUR GRANDMA Bizarre Barber’s core foundation is super simple, intuitive, and responsive. The single step mechanics with a humorous twists feel pleasant and rewarding in virtual reality. There is no better way to replicate this level [...]
Continue Reading

Awere VR

Awere VR game with biofeedback Awere is a gamified learning VR experience focused on enjoyable deep breathing and the ability to incorporate biofeedback. An abstract environment, inhabited by animated creatures, adapts and responds to each player’s breathing patterns in real-time. The player holds the Gear VR controller pressed against the belly allowing the breathing to be tracked via an accelerometer and a microphone input. The player navigates the digital environment at will and chooses whether they want to move up towards the sun or to complete the level. The soundscape is generated in real time in response to biofeedback from the player. Awere is created by Synesthetic Echo duo (Gordey Chernyy and Maria Mishurenko), hannes bend (producer, script, voice) and Kyle Wilson (music and sound design) [cl_column_inner width="1/2"][cl_column_inner width="1/2"][cl_column_inner width="1/3"][cl_column_inner width="1/3"][cl_column_inner width="1/3"]
Continue Reading

Mind Roomie

Mind Roomie VR game  Mind Roomie is a free game made that teaches children and young adults the foundations of mindfulness practice. Unlike most games, Mind Roomie encourages increasingly slow movements until the player is fully still. At the end of the play session, the player is guided through a traditional meditation exercise. Mind Roomie will be available for Google Daydream VR and might be used in the classroom setting.  Mind Roomie’s outcome is that children and teenagers learn how to meditate using a novel game experience.Gameplay is wrapped around Mindfulness Triangle: thoughts, sensations, and emotions. The first level represents sensations (i.e. cold, heavy, wind, itchy, etc.); the second level is all about detecting feelings and emotions (i.e. bored, interested, excited, tired, etc.); and the third is about choices and the feelings associated with them (i.e. was hurt, tomorrow, that happens again, buy groceries, shouldn’t have done it, etc). Thoughts are not only metaphorical, but appear on screen for the [...]
Continue Reading

Seaing Breath

Seaing Breath educational VR experience [cl_column_inner width="2/3"] Seaing Breath is the Google Daydream experience for kids about rising sea levels in Miami. Daydream controller is used as a biometric device and allows to control the experience with the breathing. The project was showcased in 2017 at multiple events in various Miami museums [cl_column_inner width="1/3"]produced by Hannes Bend, music by Kyle Wilson, voice by Paula Barros, sound recording by Travis Roig[cl_column_inner width="1/2"][cl_column_inner width="1/2"]
Continue Reading