audio学习相关

ゝ一世哀愁。 2022-01-17 03:05 214阅读 0赞

[为什么80%的码农都做不了架构师？>>> ][80_]  ![hot3.png][]

**一. Play**

AVAudioPlayer

Audio Queue: 适合stream…支持多路回放

For sample code, see the   *SpeakHere*   sample.

OpenAL: position

For sample code, see  *oalTouch*

**二. Record**

Determining Whether a Device Supports Recording

\[\[AVAudioSession sharedInstance\] inputIsAvailable\];

AVAudioRecorder

To prepare for recording using an audio recorder:

1.  Specify a sound file URL.
2.  Set up the audio session.
3.  Configure the audio recorder’s initial state.

Audio Queue Services

your application instantiates a recording audio queue object and provides a callback function. The callback stores incoming audio data in memory for immediate use or writes it to a file for long-term storage.

**三. Audio Unit Support in iOS**

<table style="border-collapse:collapse;"> 
 <tbody> 
 <tr> 
 <td style="border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-width:.5pt;border-top-color:rgb(255,255,255);border-right-width:.5pt;border-right-color:rgb(255,255,255);border-bottom-width:.4pt;border-bottom-color:rgb(125,161,181);border-left-width:.5pt;border-left-color:rgb(255,255,255);"> Audio unit </td> 
 <td style="border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-width:.5pt;border-top-color:rgb(255,255,255);border-right-width:.5pt;border-right-color:rgb(255,255,255);border-bottom-width:.4pt;border-bottom-color:rgb(126,161,181);border-left-width:.5pt;border-left-color:rgb(255,255,255);"> Description </td> 
 </tr> 
 <tr> 
 <td style="border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-width:.4pt;border-top-color:rgb(125,161,181);border-right-width:.5pt;border-right-color:rgb(237,237,237);border-bottom-width:.4pt;border-bottom-color:rgb(125,161,181);border-left-width:.5pt;border-left-color:rgb(237,237,237);"> iPod Equalizer unit </td> 
 <td style="border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-width:.4pt;border-top-color:rgb(126,161,181);border-right-width:.5pt;border-right-color:rgb(237,237,237);border-bottom-width:.4pt;border-bottom-color:rgb(126,161,181);border-left-width:.5pt;border-left-color:rgb(237,237,237);"> The iPod EQ unit, of type&nbsp;kAudioUnitSubType_AUiPodEQ,&nbsp;provides a simple, preset-based equalizer you can use in your application. For a demonstration of how to use this audio unit, see the sample code project&nbsp;iPhoneMixerEQGraphTest&nbsp;. </td> 
 </tr> 
 <tr> 
 <td style="border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-width:.4pt;border-top-color:rgb(125,161,181);border-right-width:.5pt;border-right-color:rgb(237,237,237);border-bottom-width:.4pt;border-bottom-color:rgb(125,161,181);border-left-width:.5pt;border-left-color:rgb(237,237,237);"> 3D Mixer unit </td> 
 <td style="border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-width:.4pt;border-top-color:rgb(126,161,181);border-right-width:.5pt;border-right-color:rgb(237,237,237);border-bottom-width:.4pt;border-bottom-color:rgb(126,161,181);border-left-width:.5pt;border-left-color:rgb(237,237,237);"> The 3D Mixer unit, of type&nbsp;kAudioUnitSubType_AU3DMixerEmbedded,&nbsp;lets you mix multiple audio streams, specify stereo output panning, manipulate playback rate, and more. OpenAL is built on top of this audio unit and provides a higher-level API well suited for game apps. </td> 
 </tr> 
 <tr> 
 <td style="border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-width:.4pt;border-top-color:rgb(125,161,181);border-right-width:.5pt;border-right-color:rgb(237,237,237);border-bottom-width:.4pt;border-bottom-color:rgb(125,161,181);border-left-width:.5pt;border-left-color:rgb(237,237,237);"> Multichannel Mixer unit </td> 
 <td style="border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-width:.4pt;border-top-color:rgb(126,161,181);border-right-width:.5pt;border-right-color:rgb(237,237,237);border-bottom-width:.4pt;border-bottom-color:rgb(126,161,181);border-left-width:.5pt;border-left-color:rgb(237,237,237);"> The Multichannel Mixer unit, of type&nbsp;kAudioUnitSubType_- MultiChannelMixer,&nbsp;lets you mix multiple mono or stereo audio streams to a single stereo stream. It also supports left/right panning for each input. For a demonstration of how to use this audio unit, see the sample code project&nbsp;Audio Mixer (MixerHost)&nbsp;. </td> 
 </tr> 
 <tr> 
 <td style="border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-width:.4pt;border-top-color:rgb(125,161,181);border-right-width:.5pt;border-right-color:rgb(237,237,237);border-bottom-width:.4pt;border-bottom-color:rgb(125,161,181);border-left-width:.5pt;border-left-color:rgb(237,237,237);"> Remote I/O unit </td> 
 <td style="border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-width:.4pt;border-top-color:rgb(126,161,181);border-right-width:.5pt;border-right-color:rgb(237,237,237);border-bottom-width:.4pt;border-bottom-color:rgb(126,161,181);border-left-width:.5pt;border-left-color:rgb(237,237,237);"> The Remote I/O unit, of type&nbsp;kAudioUnitSubType_RemoteIO,&nbsp;connects to audio input and output hardware and supports realtime I/O. For demonstrations of how to use this audio unit, see the sample code project&nbsp;aurioTouch&nbsp;. </td> 
 </tr> 
 <tr> 
 <td style="border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-width:.4pt;border-top-color:rgb(125,161,181);border-right-width:.5pt;border-right-color:rgb(237,237,237);border-bottom-width:.4pt;border-bottom-color:rgb(125,161,181);border-left-width:.5pt;border-left-color:rgb(237,237,237);"> Voice Processing I/O unit </td> 
 <td style="border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-width:.4pt;border-top-color:rgb(126,161,181);border-right-width:.5pt;border-right-color:rgb(237,237,237);border-bottom-width:.4pt;border-bottom-color:rgb(126,161,181);border-left-width:.5pt;border-left-color:rgb(237,237,237);"> The Voice Processing I/O unit, of type&nbsp;kAudioUnitSubType_- VoiceProcessingIO,&nbsp;has the characteristics of the I/O unit and adds echo suppression and other features for two-way communication. </td> 
 </tr> 
 <tr> 
 <td style="border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-width:.4pt;border-top-color:rgb(125,161,181);border-right-width:.5pt;border-right-color:rgb(237,237,237);border-bottom-width:.35pt;border-bottom-color:rgb(126,161,181);border-left-width:.5pt;border-left-color:rgb(237,237,237);"> Generic Output unit </td> 
 <td style="border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-width:.4pt;border-top-color:rgb(126,161,181);border-right-width:.5pt;border-right-color:rgb(237,237,237);border-bottom-width:.35pt;border-bottom-color:rgb(126,161,181);border-left-width:.5pt;border-left-color:rgb(237,237,237);"> The Generic Output unit, of type&nbsp;kAudioUnitSubType_- GenericOutput,&nbsp;supports converting to and from linear PCM format; can be used to start and stop a graph. </td> 
 </tr> 
 </tbody> 
</table>

For more information on using system audio units, see  *Audio Unit Hosting Guide for iOS*

The iOS Dev Center provides two sample-code projects that demonstrate use of system audio units:  *aurioTouch*  and  *iPhoneMultichannelMixerTest * .

Tips for Using Audio

四. Audio Session

*AddMusic*  , a sample code project that demonstrates use of an audio session object in the context of a playback application. This sample also demonstrates coordination between application audio and iPod audio.

For application sound to play, or for recording to work, your audio session must be active

you can change the category as often as you need to, and can do so whether your session is active or inactive.

An audio session comes with some default behavior. Specifically:

*  Playback is enabled and recording is disabled.  
    
 *  When the user moves the Silent switch (or Ring/Silent switch on iPhone) to the “silent” position, your audio is silenced.  
    
 *  When the user presses the Sleep/Wake button to lock the screen, or when the Auto-Lock period expires, your audio is silenced.  
    
 *  When your audio starts, other audio on the device—such as iPod audio that was already playing—is silenced.

For playback that continues when the screen is locked, use the  AVAudioSessionCategoryPlayback

To ensure that iPod music is not interrupted, configure your audio session to allow mixing. Use the  AVAudioSessionCategoryAmbient

**AVAudioSession 注意事项**

*  A VoIP app, which spends most of its time running in the background, should ensure that its audio session is active only while the app is handling a call. In the background, standing ready to receive a call, a VoIP app’s audio session should not be active.

*  An app using the “recording” category should ensure that its audio session is active only while recording. Before recording starts and when recording stops, ensure your session is inactive to allow other sounds, such as incoming message alerts, to play. Alternatively, if your recording app also provides playback, you could switch to a playback category when not recording. This also allows alert sounds to play.

The system deactivates your audio session for a Clock or Calendar alarm or incoming phone call. :  Interruptions happen when a competing audio session from a built-in application activates and that session is not categorized by the system to mix with yours.

**iOS has six audio session categories: (被系统影响或影响别的app)**

*  Three for playback  
    
 *  One for recording  
    
 *  One that supports playback and recording—that need not occur simultaneously
 *  One for offline audio processing

factory:  the Ring/Silent switch , the screen locks , other audio play or record

**How interruptions work**

*  AV Foundation framework : The system automatically pauses playback or recording upon interruption, and reactivates your audio session when you resume playback or recording.  
    
 *   Audio Queue Services, I/O audio unit : You are responsible for saving playback or recording position and reactivating your audio session after interruption ends
 *  OpenAL: implement the AVAudioSession interruption delegate methods or write an interruption listener callback function—as when using Audio Queue Services. However, the delegate or callback must additionally manage the OpenAL context.

**Route Changed **

One of the audio hardware route change reasons in iOS is kAudioSessionRouteChangeReason\_CategoryChange. In other words, a change in audio session category is considered by the system—in this context—to be a route change, and will invoke a route change property listener callback.

factory:  plugs in or unplugs a headset, or docks or undocks the device, or  Bluetooth device connects or disconnects

**To set hardware preferences, use the**  AudioSessionSetProperty  function along with the  kAudioSessionProperty\_PreferredHardwareSampleRate  kAudioSessionProperty\_PreferredHardwareIOBufferDuration

Although you can safely specify hardware preferences at any time after the audio session is initialized, best practice is to do so while the session is inactive. After you establish hardware preferences, activate the audio session and then query it to obtain the actual values. This final step is important because the system may not be able to provide what you ask for.

To obtain meaningful values for hardware characteristics, ensure that the audio session is initialized and active before you issue queries.

kAudioSessionProperty_AudioInputAvailable

Whether audio input is available on the device. Use this property to determine if audio recording is possible.

Working with Movie Players

In iOS3.1.3 and earlier , a movie player always uses a system-supplied audio session.To obtain that same behavior in iOS 3.2 and newer, you must set the movie player’s  useApplicationAudioSession  property value to  NO

If you have configured a movie player to use its own audio session, there’s some cleanup to perform. After a movie finishes, or the user dismisses it, do these two steps, in sequence, to regain the ability to play audio:

1.  Dispose of the movie player—even if you intend to play the same movie again later.
2.  Reactivate your audio session.

Optimizing for Minimal Power Consumption

For an example of how to find, instantiate, and configure audio units, see the  *iPhoneMultichannelMixerTest*  sample.

#if TARGET_IPHONE_SIMULATOR #warning *** Simulator mode: audio session code works only on a device

// Execute subset of code that works in the Simulator #else

// Execute device-only code as well as the other code

\#endif

转载于:https://my.oschina.net/dake/blog/196792

[80_]: https://my.oschina.net/u/2663968/blog/3051541
[hot3.png]: /images/20220117/626abfb83622458aaee995f283449fcd.png