speakatron - project for Music Hack Day

Sun, 09/05/2010 - 15:18 — marek

Here's the project I did for music hack day. It uses your webcam to look to see if your mouth is open and then plays a sound if it is.

  • Mac version
  • Sourcecode - mac only, for openframeworks 0061, also requires, ofxSimpleGuiToo and ofxMSAInteractiveObject

To get it to work you may have to press spacebar to enable the GUI, then adjust the threshold slider until it starts working.

Press 1, 2, 3 or 4 to try different sounds - I got a cat, a synth, birdsong and buddhist monks. Open the data/patches folder to reveal the pd patches that drive the audio.

It uses openframeworks, opencv and libzengarden for the audio - http://github.com/mhroth/ZenGarden

libzengarden is a complete re-write of puredata in C++ so you can integrate it into your own apps without the whole giant leviathan of Pd running in the background.

Video soon!

Tags: 
audio
openframeworks
mac

Comments

Mon, 09/06/2010 - 12:01 — Anonymous

Marek, get a video of this to tantalise those of us without fruit-powered machines. Stefan.

Mon, 09/13/2010 - 07:43 — Anonymous

to putup video

http://whirligigtv.yuku.com/topic/3827

Thu, 09/16/2010 - 12:59 — Anonymous

now I understand why you were asking about mouth tracking on the OF forum :)

it looks really nice!

nau

Thu, 09/16/2010 - 20:47 — Anonymous

amazing idea. but I can't make it work.
i'm on 10.5.8
best
E

Fri, 09/17/2010 - 01:10 — Anonymous

well done!

Tue, 10/05/2010 - 14:11 — Anonymous

This is a great application of a simple idea. I will note that my beard makes it go a little crazy (despite playing with threshold and such). Black hair doesn't mix well i guess. Excited to dig into your source code! thanks for this again.

Luke: Maine, USA

Thu, 11/11/2010 - 18:36 — Anonymous

This thing is really cool. I opened it up on my girlfriend's computer and totally freaked her out when she got in front of the camera and started trying to talk to me and other sounds started coming out. It took her the longest time to figure out what was going on and it made for quite a hilarious afternoon.

Add new comment

More information about text formats

Filtered HTML

  • Web page addresses and e-mail addresses turn into links automatically.
  • Allowed HTML tags: <a> <em> <strong> <cite> <blockquote> <code> <ul> <ol> <li> <dl> <dt> <dd>
  • Lines and paragraphs break automatically.

Plain text

  • No HTML tags allowed.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Lines and paragraphs break automatically.
Type the characters you see in this picture. (verify using audio)
Type the characters you see in the picture above; if you can't read them, submit the form and a new image will be generated. Not case sensitive.