How to cheat at life, with JavaScript, computer vision, and augmented reality

Can you use code to “get ahead” in life? In this talk, you’ll learn how to leverage augmented reality with JavaScript to cheat against your friends in games. [Set][1] is a visual card matching game which human brains suck at, but computers can easily brute force. We can teach your phone (using `getUserMedia`, image processing, and shape detection) to do the visual stuff and unlock a whole new world of cheating. And not to be limited to a single example, we can reuse this same approach to cheat in all aspects of our lives.

[1]: https://www.setgame.com

Mobile MIDI Orchestra

Turn small-to-large groups of attendees and their phones into an instrument-playing orchestra. Each attendee only needs to be able to follow a Guitar Hero inspired UI to play their instrument’s part. Combining everyone’s individual performances (with some redundancy) and their phone’s audio, we’ll be able to play simple to complex arrangements of any MIDI song.

I’d love to be able to have the entire hall and every attendee be able to participate in one large piece. The tech is simple and distributed enough to be able to scale to that size. This also should work as an (attended) side installation, where I teach and encourage groups to perform in small groups with each other.