[lively-kernel] First steps with Lively Sound

[John Maloney]

Excellent progress!

It will be great when the sampled audio API get's picked up by other browsers.

At the moment, I don't know of any way to do sound synthesis from a browser on iOS. Safari doesn't support either the FF or Chrome sampled sound API and, of course, the iPad doesn't support Flash either. Please let me know if you figure out a way!

	-- John


On Feb 13, 2012, at 2:06 AM, Daniel Ingalls wrote:
> Yayy, progress...
> 
> The PianoKeyboard in the Parts Bin now includes a built-in synthesizer (still very crude) so it can make sound.
> 
> There's a demo page at...
> 
>     http://lively-kernel.org/repository/webwerkstatt/users/Dan/SoundTest2.xhtml
> 
> This works in Chrome and Firefox but not in Safari, where it tries to fall back to Flash, but this does not work for some reason.  If you can figure out what is wrong with
>  the Flash code, please let us know!
> 
> Thanks to Robert 
> for several tips and fixes.
> 
>   - Dan
> -----------
> On Feb 11, 2012, at 12:20 AM, Daniel Ingalls wrote:
> 
>> Folks -
>> 
>> I finally found a simple sound interface that promises to work for Chrome and Firefox, and to invoke Flash in other cases.
>> 
>> 	https://github.com/grantgalitz/XAudioJS
>> 
>> I have a test page working now (in Chrome only) that is capable of generating samples on the fly from my PianoKeyboard morph.
>> 
>> If you'd like to play with it, check out
>> 
>> 	http://lively-kernel.org/repository/webwerkstatt/users/Dan/SoundTest1.xhtml
>> 
>> Caveats:
>> 	Of course it sounds crappy because I'm just using a sawtooth wave to test, and there's no reverb, etc, etc.
>> 	There seems to be some problem with text in firefox that is preventing it from working there
>> 		I've had the basic sound buffer working before in FF
>> 	In Safari it claims to load the Flash failure code, but that does not work yet.
>> 	Don't try glissando (sliding the mouse on the keyboard) - it will pull the keys off your piano!
>> 
>> Next steps:
>> 	Get Stereo and pan working
>> 	Port the basic synthesis kernel from Squeak for polyphony and interesting timbres
>> 
>> If you can get it working in some of the other browsers you'll be my hero.
>> 
>>   - Dan
>