Mouse and keyboard? Bah. Midi controllers? Yawn.
Learn how to control visuals in a Unity3D to Resolume pipeline using a light sensor, a cardboard box, a banana.
Modern video installations use all kinds of input devices to allow for dynamic performance and audience engagement. More often than not they involve architectural mapping, generative art, game engines.
This workshop is a walkthru, from concept to completion, of how to build an interactive 3D environment into the commonly-used VJ software Resolume. We’ll use the open-source microcontroller Arduino to handle input parameters from non-standard sources… in this case, a banana. Maybe a potato. Maybe a cardboard box. Who knows? It depends on what we’re having for lunch.
Topics to be covered:
- Concepts and strategies of interactive installation
- 3D game engine programming (Unity 3D)
- Micro-controller programming (Arduino)
- Spout (realtime video sharing network)
- Resolume (professional live event software)
Destroy Ordinary Input Devices Notes
- PC (minimum spec: Windows 8/8.1, 64bit versions only, 6gb RAM)
- Arduino board + editor (https://www.arduino.cc/en/Main/Software)
- Unity 3d (download here: https://unity3d.com/)
- Spout (download here: http://spout.zeal.co/)
- Resolume (demo version here: https://resolume.com/download/)
Nov 30 – Dec 1 · UTC+01
Billets: https://experiencevj.eventbrite.com + adhésion annuelle la Zonmé
“Experience VJ” Festival” La Zonme, Nice, France
About Eric Medine
Eric Medine is a multimedia and video artist with a BFA from the School of the Art Institute of Chicago and a MFA from the the Otis School of Art and Design in Los Angeles, California. He has shown work in galleries and museums such as the Track 16 Gallery in Santa Monica, Walled Cities Gallery in San Pedro, Andrew Shire Gallery, the Museum of Contemporary Art in Los Angeles, xm:lab and the KuunstlerHaus in Germany, Los Angeles Contemporary Exhibitions, the Chicago Motion Graphics Festival, Fêtes des Lumières, and the LPM festival in Rome and Mexico City.
As a VJ and live visuals engineer with TenTonRaygun he’s worked with performers such as Major Lazer, Meat Beat Manifesto, the Orb, Batchass, Lila Downs, Infected Mushroom, Excision, Wet Mango, Trash 80, Dan Wilcox, MegaRan, and Grammatik.
Most recently he gave a lecture at the Generate Festival in Germany on the subject of Unity Game engine integration with room sized LED voxels, and at MOCA in Los Angeles on hacking video game controllers for video installation applications.
from unity3d.com: “The Unity Editor is a creative hub for artists, designers, developers and other team members. Available on Windows and Mac, it includes 2D and 3D scene design tools, instant play mode for rapid editing and iteration, and a powerful animation system.” Basically, it’s a pro-sumer game engine. I like it because there’s a huge community for it– any problems you’re having with your build, someone has already fixed it (probably). You can download a full featured version, Pro versions have more robust network and version tracking support.
Arduino is an open-source electronics platform based on easy-to-use hardware and software. Arduino boards are able to read inputs – light on a sensor, a finger on a button, or a Twitter message – and turn it into an output – activating a motor, turning on an LED, publishing something online. You can tell your board what to do by sending a set of instructions to the microcontroller on the board. To do so you use the Arduino programming language (based on Wiring), and the Arduino Software (IDE), based on Processing.
Resolume.com is a video mixing software program with a ton of features– pixel mapping, DMX control, video mixing and playback, and various types of plugin support. You can download a full featured (but watermarked) demo version.
Spout is a realtime video sharing framework for Windows. Senders and receivers include FreeframeGL plugins, a Java interface for Processing, Jitter externals for Max/Msp, VIZZable, modules for Ableton Live, and a Virtual Webcam as a universal receiver. There is also example code for creating your own applications with openFrameworks and Cinder. Now these applications running on Windows can share video with each other in a similar way to Syphon for OSX.