Planet Arduino

What can you do with items that are destined for the dump? As seen here, if you’re Neil Mendoza, you transform old furniture, TVs, computers, art, and even an Arduino Zero that somehow ended up in the trash into a musical installation.

His resulting “House Party” features decorations and control components that according to the project’s write-up are entirely salvaged. A MIDI interface, software written in openFrameworks, and a JSON file are used to coordinate sound and movements, which include spinning picture frames and flowers, tapping shoes, and a television that loops through a rather dreary weather report snippet. 

House Party is a musical installation that explores prized possessions in their native habitat. All the materials used to create this artwork, from the furniture to the computers, were scavenged from the discarded trash. The music is a mix of mechanical and synthesized sounds. The piece was created while an artist in residence at Recology SF.

The actuators in the installation are controlled by an Arduino Zero (also found in the trash) and each screen is connected to a computer running custom software written in openFrameworks (OF). Composition was done in Logic where a MIDI environment was set up to send MIDI data to the Arduino and an OF control program. The control program then sent the data to the other computers over ethernet as OSC. For the final installation, the control program read the data from a JSON file, triggered the screens and Arduino and played the synthesized parts of the music.

Be sure to see all the zany action in the video below!

The brainchild of artist Neil Mendoza, the Robotic Voice Activated Word Kicking Machine is described as the “ideal device for anyone that feels that their verbal communication needs a little extra kick.”

The piece consists of four bells of baritone horns, tubing, microphone, speakers, a mechanical foot and a projector, while its software is written in openFrameworks. When the software starts, it launches a web browser and creates a WebSocket connection to it. As soon as someone starts speaking, the software sends a message to the browser to tell it to start speech recognition. Once the person finishes talking, the browser sends words back as text back over the WebSocket connection. Each word is then added to a Box2D physics simulation as a series of rectangles linked together with springs. There’s a mesh for each letter and shadows are created in GLSL with a shadow map.

When a word is near the foot, the computer sends a message to an Arduino telling it to kick. The foot is actuated with a linear actuator driven by a Pololu Dual VNH5019 Motor Driver Shield. There is also a foot polygon in the physics simulation. Every time the mechanical foot starts to kick, the virtual foot in the physics engine is animated with a timeline that has been matched to the actual movement of the mechanical foot.

Intrigued? Be sure to check out its official page here.