Questions tagged [opticalflow]

Optical flow or optic flow is the pattern of apparent motion of objects, surfaces, and edges in a visual scene caused by the relative motion between an observer (an eye or a camera) and the scene.

400 questions
29
votes
6 answers

What is the difference between sparse and dense optical flow?

Lots of resources say that there are two types optical flow algorithms. And Lucas-Kanade is a sparse technique, but I can't find the meanings of sparse and dense? Can some one tell me what is the difference between dense and sparse optical flow?
Yücel Ceylan
  • 382
  • 1
  • 5
  • 10
19
votes
1 answer

What is endpoint error between optical flows?

I've seen endpoint error (EPE) used as a metric for determining how close a flow estimation is to a ground truth flow, but I have a few questions about it and was hoping someone could enlighten me: What does it actually represent? How do you…
Mink
  • 857
  • 2
  • 11
  • 24
18
votes
3 answers

Optical flow ignore sparse motions

We're actually working on an image analysis project where we need to identify the objects disappeared/appeared in a scene. Here are 2 images, one captured before an action has been made by the surgeon and the other afterwards.…
Maystro
  • 2,907
  • 8
  • 36
  • 71
13
votes
1 answer

Fast, very lightweight algorithm for camera motion detection?

I'm working on an augmented reality app for iPhone that involves a very processor-intensive object recognition algorithm (pushing the CPU at 100% it can get through maybe 5 frames per second), and in an effort to both save battery power and make the…
Ertebolle
  • 2,322
  • 2
  • 18
  • 22
12
votes
2 answers

OpenCV warping image based on calcOpticalFlowFarneback

I'm trying to perform a complex warp of an image using Dense Optical Flow. I am trying to warp the second image into roughly the same shape as the first image. cv::Mat flow; cv::calcOpticalFlowFarneback( mGrayFrame1, mGrayFrame2, flow, 0.5, 3, 15,…
Goz
  • 61,365
  • 24
  • 124
  • 204
11
votes
1 answer

Lucas Kanade python numpy implementation uses enormous amount of memory

I was working on Optical Flow script using Lucas Kanade method, as University project. While it works well, there is something I can't figure out. It uses few MB of memory at start, but that amount increases rapidly every second. By the time it…
mpiekarz
  • 271
  • 4
  • 15
10
votes
1 answer

Image stabilization library Objective-C / C / C++?

is there a decent image stabilization library (something around optical flow) out there that can give me a 3 dimensional transformation matrix to stabilize with? I just want to stabilize a 10 frame sequence. A library with an Objective-C wrapper…
Geri Borbás
  • 15,810
  • 18
  • 109
  • 172
10
votes
3 answers

simple case of optical flow

General: I'm hoping that the use-case I'm about to describe is a simple case of an optical flow problem and since I don't have much knowledge on the subject, I was wondering if anyone has any suggestions on how I can approach solving my…
Myx
  • 1,792
  • 5
  • 23
  • 37
10
votes
1 answer

How to warp the later frame to previous frame using optical flow image

I just have two images,one is the current frame,the other is the optical flow image which calculated by other manners. The current frame is: The optical flow image is: My question is how to calculate the previous frame using the two images? I…
huoyan
  • 141
  • 1
  • 5
10
votes
2 answers

What is output from OpenCV's Dense optical flow (Farneback) function? How can this be used to build an optical flow map in Python?

I am trying to use the output of Opencv's dense optical flow function to draw a quiver plot of the motion vectors but have not been able to find what the function actually outputs. Here is the code: import cv2 import numpy as np cap =…
James Mallett
  • 827
  • 4
  • 11
  • 27
10
votes
2 answers

How to grab video frames in Qt?

I am new to Qt, I only know the basics: create interfaces and connect slots. In a few words, my knowledge is not deep at all. I need to open a video file and capture all of its frames to get the R, G, B channels and, later on, process optical flow…
Leonardo Lanchas
  • 1,616
  • 1
  • 15
  • 37
10
votes
3 answers

Visualize Optical Flow with color model

I've implemented a dense optical flow algorithm and I want to visualize it with following color model (color denotes direction of flow at some point, intensity denotes length of displacement vector) I've implemented a dirty version of the…
Daiver
  • 1,488
  • 3
  • 18
  • 47
9
votes
1 answer

Unknown output of OpenCV's calcOpticalFlowFarneback

I've been wondering what the optical flow matrix, that calcOpticalFlowFarneback function of OpenCV returns, tells. If I compute this Python line: flow = cv2.calcOpticalFlowFarneback(cv2.UMat(prvs),cv2.UMat(next), None, 0.5, 3, 15, 3, 5, 1.2, 0) I…
user2229358
9
votes
1 answer

How does KLT work in OpenCV?

I am curious about the logic behind KLT in openCV. From what I have known so far, the images sent to find optical flow in OpenCV is firstly converted to grayscale. What I am curious is that, when running the algorithm, we need set of features for…
ra bes
  • 143
  • 1
  • 1
  • 5
8
votes
0 answers

How to do smooth frame interpolation and extrapolation using OpenCV?

My source data files are weather radar images captured every 15 minutes. I'm trying to make a smooth interpolation of intermediate frames and I'm trying to extrapolate the motion onwards from the last measurement. So far, my method has been to…
1
2 3
26 27