what is the best video processing programming language?

Question

i have 4 digital cams, the distance between every cam is 30 CM, i need a software or a programming library that works on c++ or Java, that can take videos from these 4 cams, and put them in one video showing only one image that is gathered from the 4 cams, any hints would be helpful, Thanks anyway.

I guess you should ask about the best library or best application, not the best language. Also, for which O/S? And, how do you want to merge or select 4 videos into 1? — ChrisW, Jun 15 '10 at 20:15
Why don't you just get video editing software? This is like shooting cannons at sparrows ... — Jan K., Jun 15 '10 at 20:35

Matthew Flynn · Answer 1 · 2010-06-15T20:52:00.600

1

Look at Pure Data and GEM. It has some interesting possibilities, although it might be more than you want to bite off.

Java has the Java Media Framework, which gives you some decent tools to work with.

edited Jun 15 '10 at 20:52

answered Jun 15 '10 at 20:27

Matthew Flynn

2,210
19
27

If using Pure Data, then GEM is the standard library for video. But you can also use http://Gridflow.ca and PDP. They each are based on their own different premises. GEM is basically exposing OpenGL to Pure Data, while Gridflow is all about matrix math, mostly for video. – Hans-Christoph Steiner Dec 12 '11 at 15:15

score 1 · Answer 2 · answered Jun 16 '10 at 02:37

I would recommend you OpenCV, which is an Open Source Computer Vision library for C development. Once configured, it's relatively easy to use.

Check out this reference. Take a look at the method cvCaptureFromCAM() detailed in the reference in order to read frames from a video camera.

score 1 · Answer 3 · edited May 23 '17 at 12:19

I recommend that you use the GStreamer framework for this. I have done similar things with it: combining a video stream, a screen recording and a logo into one combined video.

Programming language options are:

C: using the API directly. It's not too hard. See the documentation.
Python: bindings to the C API
gst-launch: a declarative language for quickly setting up a pipeline. Hint: It rocks!
Vala: scripting language with C# syntax. It never used it so I can't say it it's any good.

Also check out my answer to this question: How can I tile videos/create a video montage?

score 0 · Answer 4 · answered Jun 15 '10 at 20:59

That is a stereo correspondence problem and one way to merge n different images would be using some kind of local features (SIFT, SURF, FAST etc.) In OpenCV library there's SURF detector already implemented. You would probably need to use C or C++ for real time processing.

what is the best video processing programming language?

4 Answers4