Lessons Learned from a Decade of Audio Programming

  • Опубликовано: 7 лет назад

    GDCGDC
    подписчиков: 504 тыс.

    In this 2014 GDC talk, Telltale Games' Guy Somberg offers a breakdown of his experience in 10 years of audio programming, including tricks for working with sound designers and lessons about building audio engines.
    GDC talks cover a range of developmental topics including game design, programming, audio, visual arts, business management, production, online games, and much more. We post a fresh GDC video every weekday. Subscribe to the channel to stay on top of regular updates, and check out GDC Vault for thousands of more in-depth talks from our archives.
    Follow us on Twitter
    / official_gdc
    Checkout our Facebook page for GDC exclusives
    / gamedevelopersconference
    www.gdconf.com/

@Ichomancer +102
@Ichomancer

I love how he looked around in the audience to make sure everyone finished taking a photo hahaha. Very clever man, seems like a true master of the craft.

6 лет назад
@dolphinbeta514 +2
@dolphinbeta514

Oh

4 года назад
@csebastian3 +33
@csebastian3

I like the pacing of this presentation. Very efficient delivery.

6 лет назад
@lemonslice2233 +130
@lemonslice2233

I was sold on watching this since he showed he worked on Dora the Explorer.

7 лет назад
@boptillyouflop +2
@boptillyouflop

Is that the one with a Virt soundtrack with songs in XM format? :3

5 лет назад
@nintendude794
@nintendude794

@@boptillyouflop now I want to hear this

2 года назад
@boptillyouflop +1
@boptillyouflop

@@nintendude794 Dora the Explorer: Dora's World Adventure (not the other GBA Dora Game)... seen one XM file floating around, not sure how to get the 5 others...

2 года назад
@mikeyjohnson5888 +13
@mikeyjohnson5888

Thats funny about his offhand comment abount stream limits on the xbox 360. I totally remember that instead of the gameplay lagging it would be the audio that would go first, especially remember this when it would have to load new areas, or chunks near player. Happened a lot in Fable 2.

3 года назад
@HDNShare +20
@HDNShare

10:22 - *NO* -. This answer solves almost every problems.

5 лет назад
@Limpuls +68
@Limpuls

As a guy who was interested and practicing in music producing for several years now but started programming in the web field ~2-3 years ago, only now I decided that it's time for me to merge my two favourite things which is audio and programming and thus focus on audio programming more.

5 лет назад
@grimmwerks +5
@grimmwerks

Where are you in the transition now?

4 года назад
@rishinandha_vanchi +2
@rishinandha_vanchi

floating in the vibe

4 года назад
@NOVAsteamed
@NOVAsteamed

How is it going, I'm thinking of doing that in college.

3 года назад
@earvingallardo1391 +3
@earvingallardo1391

I just started doing this, been the happiest I’ve ever been.

3 года назад
@ijustateyourrdog
@ijustateyourrdog

@@earvingallardo1391 been thinking of doing this too. going to be a long road for me (trying to self teach) but this seems like something i really want to do haha

3 года назад
@brannonharris4642 +10
@brannonharris4642

What a god tier talk. Well done. Lesson #6 is meta af. And I feel like a game such as league of legends has utterly mastered sound mixing within radius

2 года назад
@yellowblanka6058 +2
@yellowblanka6058

It's funny thinking back to the Sound card wars in the mid to late 90's, all the ads in PC Gamer etc. for Aureal, Creative etc. sound cards/technologies, Vortex etc. some interesting things with 3D Spatial sound and now we've pretty much stagnated.

2 года назад
@supersquare +24
@supersquare

Shout out to the one guy in the audience that learned audio programming lmao

4 года назад
@waldsteiger +16
@waldsteiger

usually the magnet is stationary and the coil is attached to the cone

5 лет назад
@macacoosnofa
@macacoosnofa

So like I have experience in sound design and mixing but I want to get a job in this field. What course should I take to merge code and music/sound design?

5 месяцев назад
@npc6924 +3
@npc6924

So now a question: If I want to get into engine development, and am tired of practicing graphics code, what should I learn for audio programming?

6 лет назад
@stephenborntrager6542 +26
@stephenborntrager6542

Start with understanding basic audio engineering concepts, like sample rate, bit-depth, channel formats, audio codecs, etc, and also get an understanding of audio mixing concepts like signal buss, effects sends/chains, and various common effects like reverb, stereo delay, dynamic compression, and maybe some type of 'distortion' if your feeling gutsy. As for programming concepts, there will be lots of buffers and queues, so understanding various ways to implement these will help. You will probably need a very reliable method of thread synchronization. Because audio will almost always require streaming from disk, and because you don't want to risk file IO blocking on the audio thread, you will want some sort of lock-free (or at least non-blocking) queue to separate file IO form the audio thread. If you let the audio thread stall, then you will probably get horrible sounding stutters, which are generally considered more annoying than frame-spikes. You will also need a way of interfacing with the sound hardware... this could be done through your operating systems API (SDL, ALSA, etc), or from various other libraries like OpenAL, FMOD, etc. (Though, the higher level library you rely on, the less control you have, and the more of it's issues you are stuck with.) Once that works, then you could move on to some of the more advanced math subjects, like Nyquist Theorem and Fast-Fourier-Fransforms. These concepts will help in implementing effects like pitch shift, doppler, EQ, etc... Good luck!

6 лет назад
@boptillyouflop +2
@boptillyouflop

For me, what did it was writing some VST plugins (and Buzz plugins back where Buzz was a thing).

5 лет назад
@prodbytukoo
@prodbytukoo

@@stephenborntrager6542 It's obligatory having a strong calculus background to learn about Fourier transforms and trying to implement those myself? I'm actually in first year of computer engineering but that stuff is being taught in like 4th year or 5th year. Is it realistic for me to try going for those subjects?

2 года назад
@MiRRoRRek
@MiRRoRRek

Thanks man for this vid! :) Very helpful

4 года назад
@rogerwilco2 +1
@rogerwilco2

I haven't worked on a game in my life but was happy with a lot of things he pointed out. I found them a bit obvious every now and then, but I know most people are very poor at listening. I find this both as a musician and as a language learner. Doing sound well is hard and a lot of people will not consciously notice. It's also the cause of the loudness wars in pop music.

7 лет назад
@YawLighthouse +37
@YawLighthouse

incase somebody missed the code or coming back to get it that he posted on the screen at 9:36 : float dBToVolume (float dB) { return powf(10.0f, 0.05f * dB); } float VolumeTodB (float volume) { return 20.0f * log10f(volume); }

7 лет назад
@charlesparker6167 +5
@charlesparker6167

Oldsiren I would add a check for volume==0 in the volume to db function, because this will be -Inf

6 лет назад
@sheboltaev
@sheboltaev

@@charlesparker6167 But it should be -Inf in that case, shouldn't it? I don't understand.

3 года назад
@ohhnyx9229
@ohhnyx9229

@@sheboltaev Well, you're right, it should be. The problem is that the computer can't really handle infinities. (Well, technically, floating points have the NaN (Not a Number) for anything undefined, but I don't think it woud be really helpful in this case). The solution Charles Parker gives seems good to me (I'm far from being an expert tho). You could also take care of that beforehand (You never need to stream a sound at -inf dB, so maybe you could cut it if it's under a threshold or something, Idk...)

3 года назад
@sheboltaev
@sheboltaev

@@ohhnyx9229 Maybe I misunderstood what Charles said, but I was under impression that volumeTodB would already return -Inf for 0 even without any check. Haven't tested though...

3 года назад
@ohhnyx9229
@ohhnyx9229

@@sheboltaev What I think he meant is that it mathematically would, obviously. The thing is, you *don't* want your function to be like "Yea This goes to negative infinity. I'll return a Not-a-Number and everyone will be happy!", Because it could break things in a lot of situations (if it doesn't throw an error at you in the first place). The simplest example is this algorithm: You have a float A corresponding to a volume. You set A to VolumeTodB(A) You set A to dBToVolume(A) Now, try to find what happens when A starts as 0 : VolumeTodB(A) returns NaN, since it goes to -inf. (or it may throw an error directly.I don't know exactly how C and family handle that, so let's assume it doesn't for the sake of the example) So now, A equals to NaN DbToVolume(A) then returns NaN too, because the log to something undefined is obviously undefined. You end up with A = NaN In other words, you start with a volume at 0, then convert it, deconvert it, and get an undefined volume. Not ideal, right? x) That was for the long explanation. Since you specified that you haven't tested the code, I'm guessing you program at least a little, so you may have understood my second explanation without the example. Was still worth putting it there, just in case someone with no programming knowledge reads this. If you still have questions (or you figure out that I'm totally wrong, could always happen), don't hesitate !

3 года назад
@makketronix007
@makketronix007

Careful with the 6dB = double. That is true for a voltage or current , but things change for power signals. 3dB is double the power. The ear perceives power, not voltage.

3 месяца назад
@PhillipeGrishin
@PhillipeGrishin

What a legend.

5 лет назад
@susch7466 +32
@susch7466

i love how the talk about sound has the worst audio problem

3 года назад
@logiarhythm6285 +4
@logiarhythm6285

that's your crappy phone speakers ;P

2 года назад
@jorriffhdhtrsegg
@jorriffhdhtrsegg

Its the unspoken law of youtube

Год назад
@ninevolt
@ninevolt

the classic "hairdresser with bad haircut" type problem, guess the audio fellas are too busy giving the talks rather than setting them up hahaha

Месяц назад
@tomfanman8785
@tomfanman8785

I was pulling my hair out until 13.10 (initialization of 3D sound causes POP sound). THANK YOU!

2 года назад
@DukeJon1969
@DukeJon1969

great talk!

3 года назад
@guillaumetchong1801
@guillaumetchong1801

very thorough overview of audio programming, might be true not only for a game audio engine...but what seriously happened with that hand at 18:08

6 лет назад
@soylentgreenb +30
@soylentgreenb

Playing sounds badly is nearly free. Playing sounds well is incredibly resource intensive to the point that the nobody even tries anymore. There is only one sound source and only two ears, so how does that generate complexity? The sound can reflect, refract around and transmit through objects and it's all frequency dependent. You've got doppler shifts, you've got the propagation delay before the sound reaches the listener which is different in different media, you have head related transfer functions that simulate the way the shape of the head and ear filters the sound. It gets very complex very quickly as soon as you leave the comfort zone of modern games with bog-standard stereo, or perhaps an inferior quality HRTF and some simple echo filters. Even just a very simple and incomplete implementation of partial wave tracing and with HRTFs for directional implementation, which was done 20 years ago with the aureal vortex 2 chipset, is better than anything we have today. This is a very sad fact, and I hope VR will revive the quest for accurate physical simulation of audio.

7 лет назад
@lemonslice2233 +2
@lemonslice2233

Honestly, if you want to hear good sound, Nintendo games on the WiiU are the shit.

7 лет назад
@soylentgreenb +10
@soylentgreenb

Well... they're not *the* shit, but they are shit, as is everyone else since the early 2000's when creative patent trolled Aureal to death and developers stopped trying to do correct sound rendering.

7 лет назад
@lemonslice2233 +6
@lemonslice2233

Do you even know what I'm talking out?

7 лет назад
@theIpatix +3
@theIpatix

Oh boy, I just searched Aureal Vortex 2 on YT and you're serious. That stuff sounds pretty awesome compared to stuff we got today (not even considering how old the Vortex 2 is). Obviously these kind of virtual 3d simulations have their flaws too (everything sounds "too close") or things like the 3d projection on your screen not matching the location where you actually hear it. Not sure how feasible it would be to get around that, but if those peolple in CG can do awesome sh!t, the audio people should be able to do that too.

5 лет назад
@PissMasterPlus
@PissMasterPlus

@@theIpatix I suspect that how well 3d audio matches depends on geometry of head+ears and the HRTF used in audio engine.

3 года назад
@vitinhuffc +30
@vitinhuffc

Actually the +6db = Double is kinda tricky subject, depends on what youre talkin about, sound pressure level is indeed +6db, but sound Power level is +3db and loudness level is +10db... Sound designer here Sorry ahhahahahha

3 года назад
@baronvonbeandip +12
@baronvonbeandip

>Sound designer here sorry haha It's time for you to stop.

2 года назад
@KangJangkrik
@KangJangkrik

@@baronvonbeandip nah let him laugh like supervillain, it's enjoyable

2 года назад
@lazertroll702
@lazertroll702

the coil is fixed to the cone, suspending inside the magnet which is fixed to the speaker housing. it's the coil that moves the cone, not the magnet.

2 года назад
@CaioMGA +1
@CaioMGA

09:57 is what you are looking for

6 лет назад
@justinbousquet7535 +6
@justinbousquet7535

Just saying... don't ever say the words "NO" to a creative... especially an audio engineer.  They know what they want when they ask for it. Nos will always create tension between the two of you. Word choices are very important.  Us audio people are very stubborn, "NOs" get under our skin almost immediately.  Maybe instead, ask them "Would there be something else we could create for you to use to make this task better/easier than *insert current solution here*?"

5 лет назад
@chonchjohnch
@chonchjohnch

What are you, four years old? You’re a grown fucking adult, you can be told no especially if you’re asking for something.

2 года назад
@baronvonbeandip +4
@baronvonbeandip

@@chonchjohnch You missed the point. By a long shot. Like, I'm confident you didn't read between the lines in anything he said.

2 года назад
@badunius_code +1
@badunius_code

1:25 "Playing audio is easy" * me who was introduced into audio programming back in 1994 * Rrrrrrrrigh

2 месяца назад
@rishinandha_vanchi +1
@rishinandha_vanchi

feels good to know both the languages 8:45

4 года назад
@RobLoach +36
@RobLoach

Lesson learned: Use FMOD

6 лет назад
@DukeJon1969
@DukeJon1969

Wwise is better ;)

4 года назад
@Caglarcomposes
@Caglarcomposes

@@DukeJon1969 Why is Wwise better in your opinion? I am trying to prioritize learning one of them, so if you'd explain, I'd be happy

3 года назад
@coreybertelsen7689
@coreybertelsen7689

@@Caglarcomposes If you're a sound designer/composer and learning on your own, I'd recommend Wwise - their tutorials are better. Once you learn one, you'll be able to pick up the other without much trouble. It's an oversimplification, but Wwise has kept up with more advanced features for the sound designer - stuff like an integrated audio occlusion/spatialization system that scans your 3D meshes, better 1st party plugins, more flexible parameterization and 3D options - you can tweak and randomize things like detailed 3D positioning without messing with your game engine, for example. Basically you can do more with less code. The pricing options are different as well. FMOD is more generous in this regard if your budget is less than $500k US.

3 года назад
@skope2055
@skope2055

awesome

9 месяцев назад
@timeslidr9063
@timeslidr9063

Hey Guy

5 лет назад
@JayFlyMastering
@JayFlyMastering

Teach us how to make a online mastering robot

2 года назад
@hotelsinus
@hotelsinus

1000% TRUE

Год назад
@w0mblemania
@w0mblemania

i.e. use FMOD

5 лет назад
@aloluk +2
@aloluk

Programmer time and priorities => Sound < AI < Gameplay < Graphics :(

6 лет назад
@npc6924 +4
@npc6924

aloluk in terms of immediate noticeability, this is also the order.

6 лет назад
@supersquare +7
@supersquare

Sound < AI < Gameplay < Graphics < Lootbox Roulette Screen

4 года назад
@NOVAsteamed
@NOVAsteamed

is this C

3 года назад
@RustOnWheels
@RustOnWheels

Same goes for theme parks and experiences.

3 года назад
@RustOnWheels +1
@RustOnWheels

Big budgets for the rendering machines and projectors. Scraps for the audio system.

3 года назад
@jorgegutierrezfreshglock423
@jorgegutierrezfreshglock423

13:00

Год назад
@DanielHipolitoHernando +38
@DanielHipolitoHernando

This dude cracking jokes all the time and nobody laughs smh...

2 года назад
@einsteinx2 +6
@einsteinx2

In another video I saw a similar comment and the speaker replied that people were laughing, the mic is just set up to only pick up the speaker’s voice.

10 месяцев назад
@adpt_music
@adpt_music

Audience isn’t mic’ed up

Месяц назад
@Paputsza +2
@Paputsza

I'm just bad at audio stuff to where I'm fairly certain this just isn't a talk for me. Like the other day a DJ said that spotify had bad audio quality, and I still don't hear it. A shaky camera and I'm done though because I'm more visually artistic. HAHAHA this is a job? HAHAHA I'm lost.

6 лет назад
@sonora8977 +1
@sonora8977

Paputsza it’s a hard task and most people don’t even realise it’s important until it’s too late and we save their asse(t)s near the finish line of their project.

6 лет назад
@boptillyouflop +1
@boptillyouflop

Audio coder is a job and I've done it. And yeah, I can do the thing he talks about where you can figure out the type of sound bug by ear.

5 лет назад
@chabosmulm
@chabosmulm

trust me i am a sounddesigner and 90% of sound designers, that imply they hear the minutiae of sound are full of shit. There is plenty of blind test that have shown, that anything above 192kbit/s audio quality is almost inaudible to an uncompromised audio - now translated: spotify usually plays at 192 or 320 kbit/s, while uncompressed audio plays at 1,4 million kbit/s. So if an sound designer tells you spotify sounds like "shit", well... they are full of shit. They just insecure about their hearing capabilites and must flex on others, but i guarantee you if you do blind testing on spotify premium vs cd at same volume and lufs, the difference will be inaudible. I challenge every audio engineer to this test, they will fail (cuz it has been done before and even the best couldnt diff. 320kbit vs 1,4mil kbit)

3 года назад
@tatimuryani1404
@tatimuryani1404

You dont hear anything. Then great because they're spending too much money to really care whats really matter like buy flac 24 bit 192 kHz for little improvement is just ridiculus

2 года назад
@SpacePoolNoodle +7
@SpacePoolNoodle

Damn this guy lost his job

5 лет назад
@SuperTrisset
@SuperTrisset

why doghead

5 лет назад
@SpacePoolNoodle +6
@SpacePoolNoodle

@@SuperTrisset Telltale shut down like a month ago

5 лет назад
@zenon652 +6
@zenon652

He left Telltale in 2015.

4 года назад
@baronvonbeandip +1
@baronvonbeandip

Haven't we all?

2 года назад
@sirdiealot7805 +1
@sirdiealot7805

I'm sure he's knowledgeable, but what's the takeaway from this talk?

6 лет назад
@OlleForsberg +2
@OlleForsberg

Thought I'd learn about audio programming, how hard can it be right? Now I'm sitting here looking at differently colored letters, symbols and numbers and I don't know what the hell is going on. Guess this isn't the day I learn code.

3 года назад
@yellowblanka6058 +1
@yellowblanka6058

Learning the grammar of a programming language is easy, doing something useful with it takes research and experience as well as a logical mind. It's the difference between being able to sketch some doodles with a pencil and being able to sketch a landscape scene. This is a guy who has spent over a decade learning/building experience in audio programming, you're not going to get to his level (or any other professional) without effort.

2 года назад
@jamesbrown99991
@jamesbrown99991

So 12 years of working on 300 lines of code.

3 года назад
@c4p4c1t1v3 +2
@c4p4c1t1v3

Lol, no. That was just the minimum he ever shipped. He talked about a bunch of other things that could be done

3 года назад
@elijahjflowers
@elijahjflowers

underwhelming

2 года назад
@DxBALLxD +1
@DxBALLxD

Tell them no and give them trash? Leaving.

3 года назад
@oozly9114
@oozly9114

what

3 года назад
@baronvonbeandip
@baronvonbeandip

what

2 года назад

Далее

The Golden Rules of Audio Programming - Pete Goodliffe - ADC16

51:25

The Golden Rules of Audio Programming - Pete Goodliffe - ADC16

ADC - Audio Developer Conference

Просмотров 45 тыс.

An introduction to Rust for audio developers - Ian Hobson

49:49

An introduction to Rust for audio developers - Ian Hobson

ADC - Audio Developer Conference

Просмотров 22 тыс.

Özil Skill 💫

00:25

Özil Skill 💫

LE FOOT EN VIDÉO

Просмотров 1,6 млн

CppCon 2015: Timur Doumler “C++ in the Audio Industry”

1:03:44

Masterclass | Bjørn Jacobsen - Working in Game Audio and Sound Design

1:34:35

30 Things I Hate About Your Game Pitch

37:37

30 Things I Hate About Your Game Pitch

GDC

Просмотров 1,5 млн

Top 5 Languages For Audio Programming

15:46

Top 5 Languages For Audio Programming

WolfSound

Просмотров 3,6 тыс.

Successful Freelancing in Game Audio

32:08

Successful Freelancing in Game Audio

GDC

Просмотров 19 тыс.

Bare Metal Audio Programming With Rust - Antoine van Gelder - ADC20

50:59

Bare Metal Audio Programming With Rust - Antoine van Gelder - ADC20

ADC - Audio Developer Conference

Просмотров 16 тыс.

When Optimisations Work, But for the Wrong Reasons

22:19

When Optimisations Work, But for the Wrong Reasons

SimonDev

Просмотров 579 тыс.

CHOC: Why Can't I Stop Writing C++ Libraries or Using Backronyms? -  Julian Storer - ADC22

46:44

CHOC: Why Can't I Stop Writing C++ Libraries or Using Backronyms? - Julian Storer - ADC22

ADC - Audio Developer Conference

Просмотров 2,1 тыс.