I coded a simulation in Unity which generates bouncy blocks to represent piano notes at the correct position so the physics can make music. It was a fun project to make sure that all the constraints I wanted were met. There is a lot of room to improve it, my approach ended up being a pretty brute force search for the best bounce trajectory based on the future camera position. I also included penalties for crossing the path of another ball because they could get bunched up and not find any valid moves. It would be super cool if I could have the impact velocity match the music note volume in a future design. I'm excited by the possibilities of improving generative visualizations like this for future videos! If you would like to support me making videos for this channel here is the link to my Patreon page: contact@
Hide player controls
Hide resume playing