Questions tagged [openvino]

OpenVINO™ toolkit, short for Open Visual Inference and Neural network Optimization toolkit, provides developers with improved neural network performance on a variety of Intel® processors and helps them further unlock cost-effective, real-time vision applications. The toolkit enables deep learning inference and easy heterogeneous execution across multiple Intel® platforms providing implementations across cloud architectures to edge devices.

The OpenVINO™ toolkit quickly deploys applications and solutions that emulate human vision. Based on Convolutional Neural Networks (CNN), the toolkit extends computer vision (CV) workloads across Intel® hardware, maximizing performance. The OpenVINO™ toolkit includes the Deep Learning Deployment Toolkit (DLDT).

The OpenVINO toolkit:

  • Enables CNN-based deep learning inference on the edge
  • Supports heterogeneous execution across an Intel® CPU, Intel® Integrated Graphics, Intel® FPGA, Intel® Movidius™ Neural Compute Stick, Intel® Neural Compute Stick 2 and Intel® Vision Accelerator Design with Intel® Movidius™ VPUs
  • Speeds time-to-market via an easy-to-use library of computer vision functions and pre-optimized kernels
  • Includes optimized calls for computer vision standards, including OpenCV*, OpenCL™, and OpenVX*

https://docs.openvinotoolkit.org/

https://01.org/openvinotoolkit

https://github.com/openvinotoolkit/openvino

https://github.com/openvinotoolkit/open_model_zoo

366 questions
8
votes
4 answers

Cannot install Openvino with pip

I'm trying to install Openvino to convert a Keras model into a representation for the inference engine. I'm running the command: python3 openvino/tools/mo/mo_tf.py —model_13.h5/ --input_shape=\[180,180\] This returns the error: from…
NominalSystems
  • 175
  • 1
  • 4
  • 13
6
votes
1 answer

OpenVino converted model not returning same score values as original model (Sigmoid)

I've converted a Keras model for use with OpenVino. The original Keras model used sigmoid to return scores ranging from 0 to 1 for binary classification. After converting the model for use with OpenVino, the scores are all near 0.99 for both classes…
4
votes
1 answer

openvino python inference api import error

I want to use openvino for object detection. I installed it in conda environment on ubuntu 20. I added this line in .bashrc: export LD_LIBRARY_PATH=/home/user/anaconda3/envs/openvino/bin/python3/../../lib:${LD_LIBRARY_PATH} I run after: source…
LearnToGrow
  • 1,656
  • 6
  • 30
  • 53
4
votes
1 answer

python ImportError Openvino by script and by shell

When I run python script by command sudo python script.py I get error in the line from openvino.inference_engine import IENetwork, IECore The error is ImportError: No module named openvino.inference_engine But When I open the python shell and run…
gal leshem
  • 551
  • 1
  • 6
  • 18
4
votes
1 answer

OpenVINO Convert TF Model to IR file Issue

I'm trying to convert tensorflow model to OpenVINO IR files. I have downloaded a pre-trained model from the following address: http://download.tensorflow.org/models/object_detection/mask_rcnn_inception_v2_coco_2018_01_28.tar.gz Then I extracted…
David
  • 43
  • 1
  • 5
4
votes
1 answer

cannot get the same output as the pytorch model with openvino

I have a strange problem in trying to use OpenVino. I have exported my pytorch model to onnx and then imported it to OpenVino using the following command: python /opt/intel/openvino/deployment_tools/model_optimizer/mo.py --input_model…
Luca
  • 10,458
  • 24
  • 107
  • 234
3
votes
2 answers

OnnxRuntime vs OnnxRuntime+OpenVinoEP inference time difference

I'm trying to accelerate my model's performance by converting it to OnnxRuntime. However, I'm getting weird results, when trying to measure inference time. While running only 1 iteration OnnxRuntime's CPUExecutionProvider greatly outperforms…
TBM - VOICE
  • 123
  • 1
  • 6
3
votes
1 answer

OpenVino Import Error: undefined symbol: _ZTVN15InferenceEngine5TBlobIhSt9enable_ifILb1EvEEE

Getting an import error with OpenVino in deployment. Have tried specifying all the previous versions of OpenVino in the requirments.txt file in case the issue has to do with versions. Exact error is: File…
Tekame1
  • 153
  • 4
3
votes
1 answer

How can I get YOLOv4 inference times with OpenVINO that are as fast as OpenCV?

If I run a YoloV4 model with leaky relu activations on my CPU with 256x256 RGB images in OpenCV with an OpenVINO backend, inference time plus non-max suppression is about 80ms. If, on the other hand, I convert my model to an IR following…
3
votes
1 answer

Can OpenVINO support (and use) Nvidia GPU?

I've recently installed OpenVINO following this tutorial and in the beginning it warned me that it doesn't see the graphics card. I assumed that it was talking about Intel HD Graphics (or similar), as I don't have one of these, but I have Nvidia GTX…
Bobbie
  • 163
  • 1
  • 11
3
votes
1 answer

How to use my own python code with OpenVino and the Intel Neural Compute Stick 2

I have my own AI python code for object detection. It is currently working with spyder. From a video.mp4 I detect object by calling YoloV3-tiny .cfg and .weights files. I also use the coco classes.txt file. What I want to do is to make it run in…
Hofman
  • 51
  • 1
3
votes
1 answer

How to set environment variables dynamically by script in Dockerfile?

I build my project by Dockerfile. The project need to installation of Openvino. Openvino needs to set some environment variables dynamically by a script that depends on architecture. The sciprt is: script to set environment variables As I learn,…
yellowpisagor
  • 146
  • 3
  • 13
3
votes
0 answers

openvino yolo-v3 inference error cannot convert float NaN to integer

Hello i have followed all the steps to make an inference and successfully run it on the model in this link : https://pjreddie.com/media/files/yolov3.weights but when i tried it on a model i trained with darknet i get this error : [ INFO ] Creating…
3
votes
2 answers

Running an OpenVINO Python script on boot for Raspberry PI

I am using a Raspberry Pi 3 Model B Rev 1.2 running Raspbian 10 (Buster). I want to run a python script on startup that uses OpenVINO and OpenCV to detect objects and display a stream from a webcam. I created a shell script launcher.sh that…
3
votes
1 answer

How to run the cpp samples in openvino

I am using openvino_2019.2.242 and trying to run the cpp samples in the same. Please guide me with the complete steps to build the sample applications. As an example can you provide the command to run classification sample async . Thanks in advance.
Remi_TRish
  • 193
  • 1
  • 8
1
2 3
23 24