This paper seeks to develop a reliable and computationally efficient method for estimating and predicting large‐amplitude optical flows via taking into consideration their coherence along the time dimension.
Although the differential‐based techniques for estimating optical flows have long been in wide use owing to the relative simplicity of their mathematical description, their applicability is known to be limited to the situations, when the optical flow has a relatively small norm. In order to extend such method to deal with large‐amplitude optical flows, it is proposed to model the optical flow as a composition of its time‐delayed version and a complementary optical flow. The former is used to predict the current optical flow and, subsequently, to warp forward the preceding image of the tracking sequence, while the latter accounts for the residual displacements that are estimated using Kalman filtering based on the “small norm” assumption.
The study shows that taking into consideration the temporal coherence of optical flows results in considerable improvement in the quality of their estimation in the case when the amplitude of the optical flow is relatively large and, hence, the “small norm” assumption is not applicable.
In the present work, the algorithm is formulated under the assumption that the optical flow is affine. This assumption may be restrictive in practice. Consequently, an important direction to extend this work is to consider more general classes of optical flows.
The main contribution of the present study is the use of multigrid methods and a projection scheme to relate the state equation to the apparent image motion.
