8

I have an mp3 file and I want to basically plot the amplitude spectrum present in that audio sample. I know that we can do this very easily if we have a wav file. There are lot of python packages available for handling wav file format. However, I do not want to convert the file into wav format then store it and then use it. What I am trying to achieve is to get the amplitude of an mp3 file directly and even if I have to convert it into wav format, the script should do it on air during runtime without actually storing the file in the database. I know we can convert the file like follows:

from pydub import AudioSegment
sound = AudioSegment.from_mp3("test.mp3")
sound.export("temp.wav", format="wav")

and it creates the temp.wav which it supposed to but can we just use the content without storing the actual file?

Nik391
  • 517
  • 2
  • 7
  • 24
  • Well I have a code to get the amplitude of wav file. However I wasnt sure if there is any similar package available in python to handle mp3 format – Nik391 Aug 05 '16 at 21:28
  • I don't see any problem with this question. I have seen numerous questions in this site where programmers ask if alternative ways to resolve specific problems exist. – kada mati Aug 11 '20 at 18:35

1 Answers1

7

MP3 is encoded wave (+ tags and other stuff). All you need to do is decode it using MP3 decoder. Decoder will give you whole audio data you need for further processing.

How to decode mp3? I am shocked there are so few available tools for Python. Although I found a good one in this question. It's called pydub and I hope I can use a sample snippet from author (I updated it with more info from wiki):

from pydub import AudioSegment

sound = AudioSegment.from_mp3("test.mp3")

# get raw audio data as a bytestring
raw_data = sound.raw_data
# get the frame rate
sample_rate = sound.frame_rate
# get amount of bytes contained in one sample
sample_size = sound.sample_width
# get channels
channels = sound.channels

Note that raw_data is 'on air' at this point ;). Now it's up to you how do you want to use gathered data, but this module seems to give you everything you need.

Community
  • 1
  • 1
Jacek
  • 829
  • 12
  • 31
  • Thats excellent. Thats exactly what I needed the Raw audio data. – Nik391 Aug 08 '16 at 01:33
  • @Nik391 can you please tell me how did you managed to use that raw data with respect to the Amplitude? that would be extremely helpful to me. – P.hunter Dec 12 '17 at 17:51
  • 1
    @PaulNicolashunter the raw data returned by the function is in a string format, you just need to convert it into an integer format using numpy something like this `np.fromstring(raw_data, dtype=np.int16)` – Nik391 Dec 12 '17 at 19:13
  • @Nik391 so what i'm getting is that the string('raw_data') which is in a unicode format represents the Amplitude per second right. and converting it to a numpy array it gives us the integer representation of amplitude per second am I right? – P.hunter Dec 13 '17 at 12:53
  • 1
    You need `sample_size` and `channels` to interpret `raw_data` as sound wave. Each frame is `channels*sample_size` bytes long. So if audio is mono (channel = 1) and sample_size = 2 bytes, you need to take first 2 bytes from `raw_data`, make 2-byte intereger out of it and you get the amplitude of the first frame. – Jacek Dec 13 '17 at 13:07
  • So if channels are 2 it means audio is stereo and `sample_size` is `sample width` ? and as my channels are 2 so i have to take first 2 byes of my `raw_data` how i'm supposed to achieve that? isn't the raw_data is data of all the frames? – P.hunter Dec 13 '17 at 13:42
  • 2
    If _ is a sample and you have 3 channels then song `|_ _ _| |_ _ _| |_ _ _|` has 6 samples, 3 frames. Each _ is `sample_size` bytes long. If `sample_size = 2 bytes` then my song is 12 bytes long, and played at sample_rate = 6 Hz will have duration of 1 second. – Jacek Dec 13 '17 at 13:51
  • 1
    yes, channels = 2 means audio is stereo. Each frame has information what to send to each channel, so channels are always synced together. – Jacek Dec 13 '17 at 13:52
  • 1
    "how i'm supposed to achieve that?" It's the matter of another question, how to deal with bytestring in Python language. Maybe this can help https://stackoverflow.com/questions/22824539/what-is-a-python-bytestring – Jacek Dec 13 '17 at 13:55
  • 1
    thanks mate, it was `*9 samples ,3 frames` because i see 9 `_` there, and then it means song is 18 bytes long is the sample size is 2 bytes right? and what about sample_width? does it has any connection with it? – P.hunter Dec 13 '17 at 13:58
  • yes, my bad, it has 9 samples ofc, and 18 bytes long, if `sample_size=2`. `sample_size` is `sample_width` here. – Jacek Dec 13 '17 at 14:00