53

I have a web page, which (among other things) needs to extract a specific frame from a user-uploaded video. The user seeks to a particular part of a .mp4 in the player, then clicks a button, and an ajax call gets fired off to a php script which takes the .mp4, and the exact time from the video, and uses that to extract a "thumbnail" frame.

My current solution is using the php exec command:

exec("ffmpeg -i $videoPath -ss $timeOffset -vframes 1 $jpgOutputPath");

...which works just great, except it's as slow as molasses. My guess is that ffmpeg is a little too much for the job, and I might be able to do better by utilizing the underlying libraries or something... however I have zero idea how to do that.

Ideally I don't want to have to install anything that requires a real "installation process"... i.e., dropping an executable into the folder with my web app is fine, but I'd rather not have to actually run an installer. Also, the solution should be able to run on mac, linux and windows (though linux is the top priority).

What can I do to speed this process up?

Thanks.

DanM
  • 7,037
  • 11
  • 51
  • 86
  • You could put the thumbnail generation job in a queue and let the user gets on with other stuff whilst it's generated by some other script that they don't have to wait for. – GordonM Aug 30 '13 at 14:24
  • well try to play with ffmpeg c:\ffmpeg.exe -i c:\video\hello.mov – ss 10 – t 4 -f image2 – sameq -vcodec mjpeg img-%03d.jpg It can be very tricky and it is possible that you can gain big performance improvement if you just use some different atributes... – Dusan Plavak Aug 30 '13 at 14:31
  • @DusanPlavak [`-sameq` does not mean "same quality"](http://superuser.com/a/478550/110524) and has been removed from ffmpeg. For jpg output use `-qscale:v` with an effective range of 2 (highest quality) to 31 (lowest quality). – llogan Aug 30 '13 at 18:01
  • @GordonM: The user doesn't have to wait, it just takes a while for the thumbnail to appear, especially if there are a few being generated at once. It's the actual thumbnail generation job I want to speed up. – DanM Aug 30 '13 at 18:29
  • @DusanPlavak I'm pretty sure the way I've got it set up should be doing the least amount of processing possible... no conversion of formats or anything. – DanM Aug 30 '13 at 18:30

2 Answers2

84

Of course you could code up some C/C++ and link to -lav*, basically creating a simplified version of ffmpeg just for extracting frames, and maybe even do it as a php extension (also I wouldn't run it as the same user, let alone in the same process). But the result is very unlikely to be faster, because you would only avoid some forking and setup overhead, but your likely problem is actually the decoding, which would still be the same.

Instead, you should first look into using ffmpeg in fast seeking mode (or fast/accurate hybrid mode). Their wiki states about fast seeking:

The -ss parameter needs to be specified before -i:

ffmpeg -ss 00:03:00 -i Underworld.Awakening.avi -frames:v 1 out1.jpg

This example will produce one image frame (out1.jpg) somewhere around the third minute from the beginning of the movie. The input will be parsed using keyframes, which is very fast. The drawback is that it will also finish the seeking at some keyframe, not necessarily located at specified time (00:03:00), so the seeking will not be as accurate as expected.

Fast seeking is less accurate, but a damn lot faster, as ffmpeg will not actually need to decode (most of) the movie during the seek, while fast/accurate hybrid mode is good compromise. Read the wiki page for all available options.

Edit 14/06/10:

As of FFmpeg 2.1, when transcoding with ffmpeg (i.e. not stream copying), -ss is now accurate even when used as an input option. Previous behavior can be restored with the -noaccurate_seek option. (source)

So with 2.1+, "hybrid" seeking shouldn't be required anymore for accurate results when it comes to re-encodes (and saving to .jpeg is a re-encode). It is enough to do the usual fast seeking (-ss ... -i ...) instead of slow seeking (-i ... -ss ...).

nmaier
  • 32,336
  • 5
  • 63
  • 78
0

In C/C++ using the ffmpeg libraries directly (as nmaier mentioned but didn't provide resources for) : I had this same problem and it took me a lot of work, but I have now implemented a frame extraction function in C++ directly using the ffmpeg libraries (within the QT Framework, but it should still help for plain C++).

See the function QImage Video::ffmpegLib_captureAt(const int percent, const int ofDuration) in my project Video simili duplicate cleaner Video.cpp file, it should be a self explanatory example : https://github.com/theophanemayaud/video-simili-duplicate-cleaner/blob/master/QtProject/app/video.cpp

Théophane
  • 71
  • 7