3

I'm trying to build an app that uses a digital filter to process audio playing from other (stock music player and spotify etc) apps.

So far I've been able to create the filter for audio input from the mic in OpenSL ES. The filtered audio is then sent to the hardware output. The app was based on this toutorial http://audioprograming.wordpress.com/2012/03/03/android-audio-streaming-with-opensl-es-and-the-ndk/

How do I get a similar input buffer from other apps so that I can process it before its sent to the hardware output?

Its not a requirement to use OpenSL ES or other native code. To clarify; the app should apply the custom filter effect in a similar way as android.media.audiofx.AudioEffect before it was deprecated could be attached to the global audio output mix (audio session 0).

BenMorel
  • 34,448
  • 50
  • 182
  • 322
daker
  • 3,430
  • 3
  • 41
  • 55

1 Answers1

3

An app can't modify (or even read, if you discount the Visualizer API) the audio output from other apps.

Just a note about audio session 0: it's still possible to use it (as of JB / JB MR1), but that possibility might go away in future Android versions. There's one important detail to keep in mind though, which is that effects added on session 0 will be suspended if an app adds an effect on a session other than 0.

The audio HAL keeps track of the (estimated) CPU usage for all enabled audio effects and will deny new effects to be enabled if doing so would cause the CPU cycle budget to be exceeded. This means that if apps were allowed to freely stack up effects on session 0 without being suspended, they could mess up apps like Spotify by denying them the ability to choose which effects to enable on their own audio session because the CPU cycle budget has been exceeded.

Michael
  • 57,169
  • 9
  • 80
  • 125
  • Thank you. Then how do existing DSP apps work? There are several apps using OpenSL ES, ffmpeg etc. to modify the sound comming from other apps. – daker Mar 14 '13 at 08:03
  • I don't know. I've only tried two such apps; one of them force-closed when I tried to start it, and the other just used the built-in AudioEffects and attached them to session 0. – Michael Mar 14 '13 at 09:20
  • A workaround like in this thread might be possible (http://stackoverflow.com/questions/14055272/android-4-0-ideas-how-to-record-capture-internal-audio-e-g-stream-music). – daker Jul 25 '13 at 14:41