1

Does anyone have a independent evaluation of using Deepstream Gstream pipline instead of a conventional python code?

Gstreamer: USB-CAM -> Appsink -> (CPU to GPU) AI analysis (TensorRT) -> CV2.ImShow

I think I understand that deepstream uses the GPU only in the gstreamer pipeline but is it faster. Any comparison. Where/what do I gain by using the deepstreamer?

mkrieger1
  • 19,194
  • 5
  • 54
  • 65
Magnus_G
  • 49
  • 8

1 Answers1

1

GStreamer is a pipeline-based multimedia framework that links together a wide variety of media processing systems to complete complex workflows. For instance, GStreamer can be used to build a system that reads files in one format, processes them, and exports them in another. The formats and processes can be changed in a plug and play fashion.

Deepstream utilizes gstreamer to do some tasks in a cascade routine. As

Deepstream feed input streams to the pipeline and since gstreamer has different plugins, streams pass through this pipeline. Nvidia made some plugin in addition to gstreamer plugin.

For example pgie, tracker , tiler, nvvidconv, nvosd, transform, sink and ... are some of them. Deepstream runs main loop on GPU, so primary model and secondary models could do inferences. Accessing to output of each plugins- like pgie or sgie- is possible via metadata. These metadatas includes frame data, object location, time of occurrence and .... It is possible to access these metadata via some function in plugins like gstdsexample. Having these data make it easy to do process on a stream like data.

Alongside these benefit it(Deepstream) has some disadvantages: making a complex pipeline and working with it, is hard.

When you have a stream data(video, text, speech, image and ...) it's better to utilize this pipeline. Also, python and C++ implementation is possible.

BarzanHayati
  • 637
  • 2
  • 9
  • 22
  • Thanks for the input. I am still puzzled. Most people still utilizes other means that using deepstream so there must be something that makes it bad. nVidia themselves seems to push for it but there is not any good examples or support by the communities so I guess its not common utility yet. – Magnus_G Oct 14 '22 at 15:12
  • 1
    @Magnus_G Deepstream is not completely open source platform. So sometimes it is challenging work with it. – BarzanHayati Oct 14 '22 at 16:25
  • What could you do with deepstream completely depends on how nvidia brings facilities to us. Sometimes it not presents open source codes for some functionalities and it guides me to trouble. – BarzanHayati Oct 14 '22 at 16:48