Fact-checked by Grok 2 weeks ago

Motion compensation

Motion compensation is a signal processing technique used to estimate and correct for the effects of motion in sequential data acquisition systems, such as video streams, radar signals, and medical scans, thereby reducing distortions, redundancies, and artifacts to enhance image quality and data efficiency.^[1] In video compression, motion compensation plays a central role by predicting pixel values in a current frame from reference frames using estimated motion vectors, which exploit temporal redundancies to minimize the data required for encoding while preserving visual fidelity; this is fundamental to standards like H.264/AVC and HEVC, where block-based methods divide frames into macroblocks (e.g., 16×16 pixels) for vector estimation via metrics like sum of absolute differences (SAD).^[1] Key variants include overlapped block motion compensation (OBMC) to mitigate blocking artifacts by averaging predictions from adjacent blocks, and global motion compensation (GMC) for modeling camera-induced movements like panning or zooming with parametric models (e.g., affine transformations), as standardized in MPEG-4 to reduce overhead at low bit rates.^[1] These approaches support sub-pixel accuracy (e.g., quarter-pixel in H.264) and multiple reference frames, improving prediction by up to 0.3–0.7 dB in peak signal-to-noise ratio (PSNR) with minimal bitrate increase.^[2] Beyond video, motion compensation is essential in radar imaging, particularly synthetic aperture radar (SAR) and inverse SAR (ISAR), where it corrects for translational and rotational errors due to platform or target motion during long-duration signal collection; for instance, in ISAR, it focuses smeared images by estimating Doppler shifts and applying phase adjustments, enabling high-resolution target recognition for maritime surveillance.^[3] In medical imaging, such as cone-beam computed tomography (CBCT) for extremities, image-based compensation algorithms statistically optimize reconstructions without external tracking, reducing motion-induced blurring and improving diagnostic accuracy in dynamic scenarios like respiratory or cardiac movement.^[4] As of 2025, advancements in motion compensation increasingly integrate machine learning and multi-sensor fusion for real-time applications across these domains, balancing computational complexity with performance gains.^[5]

Fundamentals

Definition and Purpose

Motion compensation (MC) is a technique in signal processing that predicts a signal at a given time instant using information from previous or future instants, particularly applied to video sequences but also in other fields like radar and medical imaging to model motion and exploit temporal redundancy in sequential data.^[6] While the principles are illustrated here with video examples, they extend to other domains such as radar signal processing and medical imaging. In video processing, this involves estimating motion vectors that describe the displacement of image elements from one frame to another, allowing for accurate prediction of subsequent frames.^[7] Video data inherently contains spatial redundancy, where neighboring pixels within a single frame exhibit high correlation due to similar intensities, and temporal redundancy, where adjacent frames share substantial similarities from scene continuity and limited motion.^[8] Motion compensation addresses temporal redundancy by generating a predicted frame from a reference frame, shifted according to the estimated motion, which minimizes the prediction error—the difference between the actual and predicted frame.^[6] In compression applications, this enables efficient encoding by transmitting only the motion vectors and the residual error signal rather than the entire frame, significantly reducing the required bitrate.^[7] The primary purpose of motion compensation in video compression is to enhance coding efficiency by reducing data volume while preserving perceptual quality, achieving bitrate reductions of a factor of three or more compared to spatial-only encoding methods.^[6] This approach improves video quality at low bitrates by better handling motion-induced changes and supports applications beyond compression, such as frame rate conversion through interpolation of intermediate frames using motion estimates.^[9] A common implementation, block motion compensation, divides frames into blocks to estimate and apply motion on a localized basis, though more advanced methods exist.^[6]

Basic Principles

Motion compensation relies on mathematical models to approximate the movement of objects between consecutive video frames. The simplest and most widely used model is the translational motion assumption, which posits that pixels undergo a rigid body shift represented by a two-dimensional motion vector (d_x, d_y). This model effectively captures uniform motion but fails to account for complex deformations such as rotation or scaling.^[10] To address these limitations, more advanced models like the affine motion model incorporate parameters for translation, rotation, and zoom. The affine model transforms coordinates as x' = a_1 x + a_2 y + a_0 and y' = b_1 x + b_2 y + b_0, where the coefficients enable handling of shear and scaling effects.^[11] For even greater flexibility in scenarios involving perspective distortion, such as those induced by camera movement, the perspective model, often implemented as a projective transformation (homography) that includes a division by a depth-related term, allowing compensation for depth variations and non-planar motions.^[11] The motion estimation process involves identifying the optimal motion vectors (MVs) that minimize the difference between a target frame I(x,y,t) and its prediction from a reference frame I(x,y,t-1). This is typically achieved through search algorithms that evaluate candidate displacements within a defined search window. The full search method exhaustively compares all possible positions, ensuring the global minimum error but at high computational cost.^[10] Faster alternatives, such as the three-step search, progressively refine the search by starting with coarse steps and narrowing to finer ones, using a logarithmic pattern to reduce evaluations while approximating optimality.^[12] The core displacement equation defines the predicted pixel value as P(x,y,t) = I(x - d_x, y - d_y, t-1), where (d_x, d_y) is the estimated MV.^[10] In the compensation step, these MVs are applied to warp the reference frame, generating a predicted frame that aligns with the target. The residual frame, capturing unmodeled differences, is then computed as E(x,y) = I(x,y,t) - P(x,y,t), which is subsequently encoded to reconstruct the original frame when combined with the prediction.^[10] MV selection during estimation relies on error metrics such as the sum of absolute differences (SAD), defined as \sum |I(x,y,t) - I(x - d_x, y - d_y, t-1)|, or mean squared error (MSE), which squares the differences for greater sensitivity to outliers.^[10] These metrics prioritize predictions that minimize temporal redundancy. Despite these principles, motion compensation faces inherent challenges. The aperture problem arises when local image features, such as edges, provide ambiguous motion cues perpendicular to their gradient, requiring contextual information from surrounding areas for accurate estimation.^[10] Occlusions occur when parts of the scene become hidden between frames, leading to mismatched predictions and increased residual energy in affected regions.^[13] Noise in the input frames further complicates estimation by introducing spurious variations that can bias MV selection, often necessitating robust filtering or multi-frame references to mitigate distortions.^[10] These issues are commonly addressed through block-based implementations that segment frames for localized estimation.^[10]

Core Techniques

Block Motion Compensation

Block motion compensation is a foundational technique in video coding that divides each frame into fixed-size blocks, typically assuming uniform translational motion within each block to estimate and apply motion vectors (MVs) independently. This approach enables efficient temporal prediction by matching blocks from a current frame to corresponding regions in a reference frame, reducing redundancy across frames. Originating from research in the 1980s, it was formalized in the ITU-T H.261 standard (1990), which introduced block-based prediction for low-bitrate video telephony.^[14]^[10] In block partitioning, video frames are segmented into non-overlapping macroblocks, commonly 16×16 pixels for luminance in early standards like H.261, with each macroblock further divided into 8×8 blocks for processing. This structure assumes that motion is constant within the macroblock, allowing a single MV to represent the displacement for the entire unit. Block sizes vary across applications and standards, ranging from 4×4 to 64×64 pixels depending on content resolution and complexity, balancing detail capture with computational load. For instance, smaller blocks better approximate irregular motions but increase overhead in MV transmission.^[14]^[10] The motion estimation process employs block matching algorithms to determine the optimal MV for each block. In the standard exhaustive search method, candidate blocks in a reference frame (typically the previous frame for forward prediction) within a defined search window—often ±15 pixels in H.261—are compared to the current block using metrics like sum of absolute differences (SAD) or sum of squared differences (SSD). The MV corresponds to the displacement yielding the minimum error; for example, if a 16×16 block at position (x, y) in the current frame best matches a block shifted by (dx, dy) = (3, -2) pixels in the reference, that integer-pixel MV is selected. This process, while accurate, is computationally intensive, prompting optimizations like three-step search in practice.^[14]^[10] During compensation, the selected MV shifts the matching block from the reference frame to predict the current block's content. The prediction error, or residual, is then computed as the pixel-wise difference between the actual current block and the shifted reference block; for the example above, residual = current[x+i][y+j] - reference[x+dx+i][y+dy+j] for i, j in [0, 15]. This residual, rather than the full block, is encoded and transmitted, exploiting temporal correlations to achieve significant compression gains, such as up to 75% bit-rate reduction in early implementations.^[10] Block motion compensation offers computational efficiency suitable for hardware implementations due to its regular grid structure and parallelizable operations, making it a cornerstone of standards from H.261 onward. However, it introduces limitations like blocking artifacts at block edges, where discontinuities arise from independent MV assignments, particularly in areas of complex or non-uniform motion. These artifacts can propagate in decoding, degrading visual quality. For improved accuracy in non-integer motions, the technique can be extended to sub-pixel estimation, though this adds complexity.^[10]

Global Motion Compensation

Global motion compensation is a technique in video processing that models uniform motion across an entire frame or scene using a single set of parameters, such as translation, rotation, and scale, to handle camera-induced movements like panning or zooming without relying on fine-grained object details. This approach contrasts with local motion vector estimation by applying one global transformation to the whole reference frame, making it particularly effective for sequences where the dominant motion is homogeneous.^[15] The motion is typically represented by a parametric affine transformation model with six parameters, defined as:

\begin{align*} x' &= a_{11} x + a_{12} y + a_{13}, \\ y' &= a_{21} x + a_{22} y + a_{23}, \end{align*}

where (x', y') are the transformed coordinates, and (x, y) are the original pixel positions. Parameter estimation involves least-squares fitting to feature points or optical flow fields, minimizing the prediction error between the current frame I(x,y,t) and the warped reference frame.^[15] This global motion vector \mathbf{MV}_{global} is computed as:

\mathbf{MV}_{global} = \arg\min_{\mathbf{MV}} \sum_{(x,y)} \left[ I(x,y,t) - \warp\left(I(x,y,t-1; \mathbf{MV})\right) \right]^2,

where \warp applies the parametric transformation. Unlike local motion vectors that vary per block, this single set reduces redundancy in scenes dominated by camera motion.^[15] In application, the entire reference frame is warped using these parameters to predict the current frame, which lowers bit overhead in compression by avoiding multiple local vectors, especially in panning or zooming scenarios.^[16] This method offers advantages including reduced computational cost and fewer bits for motion vectors in homogeneous motion environments, achieving up to 20% bitrate savings compared to translational models. However, it has limitations in scenes with independent object motions, where the uniform model fails to capture local variations.^[15] Global motion compensation is notably employed in standards like MPEG-4 for sprite coding, where it compensates the background across frames to generate a unified sprite image, improving efficiency when foreground objects occupy only 10-15% of the frame.^[16]

Advanced Motion Estimation Methods

Sub-Pixel Motion Compensation

Sub-pixel motion compensation addresses the limitations of integer-pixel motion vectors by estimating motion at fractional resolutions, such as half or quarter pixels, to better capture the continuous nature of real-world object movements in video sequences. Integer-pixel motion vectors, which align blocks on a discrete grid, often introduce aliasing artifacts and reduce prediction accuracy because actual motions do not align perfectly with pixel boundaries. This fractional refinement enhances the temporal prediction, leading to more precise matching between reference and current frames. For half-pixel accuracy, bilinear interpolation is commonly employed to generate intermediate pixel values. The value at a half-pixel position, such as P_{\frac{1}{2}}(x+0.5, y), is computed as the average of the four surrounding integer pixels:

P_{\frac{1}{2}}(x+0.5, y) = 0.25 \times [I(x,y) + I(x+1,y) + I(x,y+1) + I(x+1,y+1)]

where I denotes the reference frame intensity. This simple averaging provides a low-complexity approximation suitable for early standards. Quarter-pixel (QPel) motion compensation builds on half-pixel methods for even higher precision, often using a half-pixel intermediate step followed by additional interpolation. In H.264/AVC, half-pixel positions are interpolated with a 6-tap finite impulse response (FIR) filter, defined by coefficients [1, -5, 20, 20, -5, 1]/32 for luma samples, to reduce aliasing compared to bilinear methods.^[17] Quarter-pixel positions are then obtained via bilinear interpolation between integer and half-pixel locations. Alternative approaches, such as Wiener-based filters, optimize for specific content to minimize interpolation errors, though the 6-tap FIR remains the standard for its balance of performance and efficiency. Quarter-pixel precision was first introduced in H.263 Annex F in 1996 as part of the Advanced Prediction Mode and extended in H.264/AVC for broader adoption.^[18] To estimate sub-pixel motion vectors, an initial integer-pixel search is refined by evaluating fractional offsets around the best integer candidate, typically using a small search pattern like a diamond or hexagonal grid. This refinement involves computing interpolated block matches, which increases computational cost; for example, quarter-pixel estimation can require up to four times the operations of integer-pixel search due to the need for multiple interpolations per candidate. Despite this, optimizations like early termination based on rate-distortion costs mitigate the overhead in practical encoders.^[19]^[20] The primary benefits of sub-pixel motion compensation include improved compression efficiency, with typical PSNR gains of 1-2 dB over integer-only methods, particularly in sequences with smooth or non-translational motion. In H.263, quarter-pixel support in Annex F enabled better low-bitrate performance, while in H.264, it contributes to overall bitrate reductions of up to 50% compared to prior standards like MPEG-2. These gains stem from reduced residual energy after prediction, allowing more effective entropy coding.^[21] However, sub-pixel techniques introduce challenges, including significantly higher computational complexity during both estimation and compensation, which can strain real-time encoding on resource-limited hardware. Additionally, the low-pass filtering inherent in interpolation processes, such as the 6-tap FIR, may cause over-smoothing of high-frequency details, leading to blurring artifacts in reconstructed frames if not balanced with deblocking filters.^[20]^[22]

Variable and Overlapped Block Methods

Variable block-size (VBS) motion compensation extends traditional fixed-size block methods by allowing the encoder to dynamically select block dimensions that better align with local motion patterns, thereby improving prediction accuracy and reducing residual errors. In standards like H.264/AVC, this is achieved through hierarchical partitioning of macroblocks, starting from 16×16 down to smaller 4×4 blocks in a tree-structured manner, enabling finer granularity for complex scenes.^[23] The selection of optimal block sizes is typically guided by rate-distortion optimization, minimizing a cost function of the form

J = D + \lambda R

where D represents the distortion (e.g., mean squared error) between the original and predicted blocks, R is the bitrate required to encode the motion vectors and residuals, and \lambda is a Lagrange multiplier balancing the trade-off. This approach, rooted in Lagrangian optimization techniques, ensures efficient allocation of bits while adapting to varying motion characteristics.^[24] Overlapped block motion compensation (OBMC) addresses blocking artifacts that arise at block boundaries in standard motion compensation by blending predictions from adjacent blocks that overlap in the current region. For a given pixel, the final prediction is a weighted average of contributions from the motion vectors of the current block and its four (or fewer) neighboring blocks, with weights inversely proportional to the distance from the pixel to each block's center, effectively smoothing transitions and reducing edge discontinuities. This estimation-theoretic formulation treats the prediction as a linear minimum mean square error estimator based on available block motion information, enhancing overall prediction quality particularly in areas with irregular motion.^[25] In practice, VBS is implemented using tree-structured coding, where macroblocks are recursively partitioned into sub-blocks, and mode decisions are made at each level to propagate efficient representations, as seen in H.264/AVC.^[26] OBMC, meanwhile, is integrated into MPEG-4 Advanced Simple Profile (ASP) as an optional advanced prediction mode, borrowing from H.263's Annex F to apply overlapping during inter-frame prediction without increasing the number of motion vectors.^[27] These methods offer key advantages, including superior adaptation to irregular or object-boundary motions compared to fixed blocks, which mitigates visible blocking artifacts and improves subjective quality.^[28] In codecs like VC-1 and AV1, VBS contributes to compression efficiency gains of up to 10% in bitrate reduction for equivalent quality, particularly in high-motion sequences, by allowing more precise partitioning.^[29] However, both techniques increase encoder complexity substantially, as VBS requires exhaustive mode evaluation across multiple partition levels and OBMC demands additional blending computations, often leading to 5-10 times higher processing demands than basic block methods.^[30] Variable blocks can also incorporate sub-pixel motion estimation for even finer control over predictions.^[28]

Motion Compensation in Transform Coding

Motion-Compensated Discrete Cosine Transform

The motion-compensated discrete cosine transform (MC-DCT) represents a hybrid framework in video coding where motion compensation (MC) first generates a prediction of the current frame from a reference frame, and the discrete cosine transform (DCT) is then applied to the resulting prediction residual to exploit spatial redundancies in the frequency domain.^[31] In this approach, block-based MC estimates motion vectors to form the prediction \hat{f}(x,y), and the residual E(x,y) = f(x,y) - \hat{f}(x,y) is computed, where f(x,y) is the original frame intensity. The DCT transforms this residual into frequency coefficients, given by

E(u,v) = \sum_{x=0}^{N-1} \sum_{y=0}^{N-1} E(x,y) \cos\left[\frac{(2x+1)u\pi}{2N}\right] \cos\left[\frac{(2y+1)v\pi}{2N}\right],

for an N \times N block, typically with N=8.^[32] This transformation concentrates the residual energy into lower-frequency coefficients, facilitating efficient quantization and entropy coding.^[31] The DCT is applied to MC residuals aligned on fixed block sizes, commonly 8×8 pixels for the transform itself, while MC operates on larger 16×16 macroblocks to generate the residuals; subsequent steps involve uniform or adaptive quantization of the DCT coefficients followed by variable-length coding for further compression.^[31] This block-aligned processing ensures compatibility with the spatial correlation model assumed by the DCT, though misalignment at block boundaries can introduce minor artifacts.^[33] By combining MC's exploitation of temporal correlations with DCT's handling of spatial correlations in the residual, MC-DCT achieves significant bitrate reductions compared to intra-frame coding alone, forming the core of standards like MPEG-1 (1993) and MPEG-2 (1995), where it enabled DVD-quality video at bitrates as low as 4-6 Mbit/s through compression ratios of 20-40:1.^[33]^[34]^[35] Variations of MC-DCT include frequency-domain refinements, such as DCT-based motion estimation that adjusts motion vectors based on phase shifts in DCT coefficients or predicts coefficients across frames to reduce residual variance.^[36] These approaches perform MC directly in the transform domain, potentially lowering computational complexity by avoiding spatial-domain operations.^[37] A key limitation of MC-DCT is its sensitivity to motion vector errors, which can produce residuals with increased high-frequency components that propagate through quantization, leading to visible blocking artifacts or reduced compression efficiency, particularly at low bitrates or complex motion scenes.^[31]

Integration with Other Transforms

Motion compensation is often integrated with integer approximations of the discrete cosine transform (DCT) to enable efficient computation without floating-point operations, particularly in standards like H.264/AVC. In H.264/AVC, the 4x4 integer transform approximates the DCT by separating the process into a core integer matrix multiplication followed by scaling and quantization, which avoids the need for irrational coefficients and divisions in the inverse transform. The core forward transform matrix H is defined as:

H = \begin{bmatrix} 1 & 1 & 1 & 1 \\ 2 & 1 & -1 & -2 \\ 1 & -1 & -1 & 1 \\ 1 & -2 & 2 & -1 \end{bmatrix}

This design ensures exact invertibility using integer arithmetic, reducing computational complexity while maintaining near-DCT performance for motion-compensated residuals.^[38]^[39] Wavelet-based approaches extend motion compensation by incorporating overcomplete wavelet representations, which facilitate motion estimation across multiple scales and handle non-stationary video signals more effectively than block-based methods. Overcomplete wavelets provide redundant subband decompositions that align well with motion-compensated temporal filtering, allowing for robust handling of occlusions and scaling. The lifting scheme is commonly employed in these systems to construct invertible wavelet transforms directly in the temporal domain after motion compensation, enabling in-place computation and adaptability to video hierarchies without full matrix inversions.^[40]^[41]^[42] Hybrids with the Karhunen-Loève transform (KLT) adapt the basis functions to the statistical properties of motion-compensated prediction errors, offering content-adaptive decorrelation superior to fixed transforms like DCT. In motion-compensated frameworks, KLT is applied to residual sub-images or temporal subbands, deriving optimal eigenvectors from covariance models of displaced frame differences to minimize coding redundancy. This approach is particularly effective for high-bitrate scenarios where signal statistics vary, providing theoretical bounds on compression gains through conditional KLT derivations.^[43]^[44]^[45] These integrations reduce overall complexity by leveraging integer operations and adaptive bases, avoiding floating-point divisions and enabling faster encoding/decoding pipelines. For instance, integer transforms in H.264/AVC achieve comparable energy compaction to floating-point DCT with up to 50% fewer operations in hardware implementations. In the AV1 codec (finalized in 2018), motion compensation pairs with extended DCT-like transforms, including asymmetric discrete sine transforms (ADST) and identity variants, yielding approximately 30% better compression efficiency than H.264 for similar quality levels across diverse video content.^[46]^[47]

Applications

Video Compression Standards

Motion compensation plays a pivotal role in video compression standards by exploiting temporal redundancy between frames to achieve substantial bitrate reductions, forming the core of inter-frame prediction in hybrid coding frameworks. Early standards introduced basic block-based techniques, evolving to more sophisticated methods that incorporate sub-pixel accuracy, variable block sizes, and advanced prediction modes to enhance efficiency without proportional increases in complexity. The MPEG lineage marked foundational advancements in motion compensation. MPEG-1, standardized in 1993 as ISO/IEC 11172-2, employed basic block-based motion compensation using 16x16 macroblocks with half-pixel accuracy to predict frame differences, enabling efficient compression for digital storage media like CD-ROMs.^[10] Building on this, MPEG-2 (ITU-T H.262 | ISO/IEC 13818-2, 1995) introduced bidirectional motion compensation through B-frames, which interpolate predictions from both preceding and subsequent reference frames, improving efficiency for broadcast and DVD applications.^[48] MPEG-4 Part 2 (ISO/IEC 14496-2, 1999) further advanced the technique with global motion compensation, using parametric models to describe camera movements across entire frames or sprites, and overlapped block motion compensation (OBMC) to reduce blocking artifacts at block boundaries by blending predictions from adjacent blocks.^[49]^[50] Parallel developments in the ITU-T H.26x series refined motion compensation for low-bitrate and high-efficiency scenarios. H.263 (1996) incorporated quarter-pixel motion compensation as an optional advanced prediction mode, allowing finer-grained motion vectors (1/4-pixel resolution) to better capture sub-pixel movements, particularly beneficial for video telephony over narrowband channels.^[51] H.264/AVC (ITU-T H.264 | ISO/IEC 14496-10, 2003) introduced variable block sizes for motion compensation, ranging from 16x16 down to 4x4 pixels, enabling adaptive partitioning to match complex motion patterns; this was integrated with context-adaptive binary arithmetic coding (CABAC) for entropy-efficient representation of motion data.^[52] H.265/HEVC (ITU-T H.265 | ISO/IEC 23008-2, 2013) extended block sizes up to 64x64 pixels via flexible coding tree units, supporting larger homogeneous regions in high-resolution video, and added merge modes that inherit motion vectors from spatially or temporally neighboring blocks to simplify prediction signaling and reduce overhead.^[53] Royalty-free alternatives have also adopted advanced motion compensation to compete with licensed standards. VP9, released by Google in 2013 under the WebM project, features compound prediction modes that blend predictions from two reference frames using weighted averaging, alongside 1/8-pixel motion accuracy, to achieve high efficiency for web streaming.^[54] AV1, finalized by the Alliance for Open Media in 2018, builds on this with enhanced compound prediction supporting 11 reference frame combinations and wedge-based partitioning for blending, enabling up to 30% additional bitrate savings over VP9 in inter-frame coding.^[55] Motion compensation accounts for the majority of compression efficiency in inter-frame coding within these standards, often responsible for 50-70% of the overall computational effort in encoding while driving substantial bitrate reductions. For instance, HEVC achieves approximately 50% bitrate savings compared to H.264/AVC at equivalent subjective quality, largely attributable to its refined motion compensation tools like larger blocks and merge modes, as verified in standardization tests.^[56]^[57]

Image Stabilization and Processing

Motion compensation plays a crucial role in video stabilization by estimating and correcting unwanted camera movements to produce smoother footage. In typical approaches, global motion is estimated using techniques such as optical flow analysis, which tracks pixel displacements between frames, or gyroscope data from device sensors to detect rotations and translations. These estimates are then smoothed—often via Kalman filtering to predict and correct motion paths—and applied through frame warping to align and stabilize the video sequence.^[58]^[59]^[60] Video stabilization methods can be categorized as full-reference, which rely on a predefined stable reference path for comparison and correction, or no-reference, which operate solely on the input footage without external benchmarks, making them more versatile for real-world applications. For instance, no-reference methods often employ feature trajectory tracking to robustly handle occlusions and lighting changes during motion estimation. Smoothing algorithms like Kalman filters model camera motion as a constant-velocity process, recursively estimating position and velocity while constraining outputs to avoid artifacts such as black borders in cropped frames.^[61]^[59] In consumer electronics, motion compensation integrates with hardware like optical image stabilization (OIS) in smartphones, where gyroscopes detect shakes and actuators adjust the lens in real-time to compensate for motion before image capture. Apple introduced OIS in the iPhone 6 Plus in 2014, enabling sharper images and videos under handheld conditions by countering small angular movements up to several degrees.^[62] Frame interpolation leverages motion compensation to generate intermediate frames, effectively increasing frame rates for smoother playback, such as doubling from 30 to 60 frames per second. Optical flow-based methods estimate dense motion fields between existing frames and warp pixels along these trajectories to synthesize new frames, preserving temporal consistency and reducing artifacts in dynamic scenes. This approach is particularly effective for handling nonlinear motions, though it requires refinement to address occlusions.^[63]^[64] Super-resolution techniques employ multi-frame motion compensation to enhance image resolution by aligning sub-pixel shifts across multiple low-resolution frames and fusing their details into a higher-resolution output. Motion estimation, often via optical flow or recurrent networks, warps previous high-resolution estimates to the current frame, enabling the integration of temporal information while minimizing alignment errors. For example, frame-recurrent models process low-resolution inputs sequentially, upscaling motion fields to align and merge frames efficiently, achieving up to 4x resolution gains with improved temporal coherence.^[65]^[66] Real-time implementation of these motion compensation methods faces significant challenges, including computational demands for accurate optical flow estimation and warping on resource-limited devices, often requiring optimized algorithms to maintain low latency without sacrificing quality. In mobile applications, balancing precision with processing speed is critical, as delays can degrade user experience in live video processing.^[60]^[67]

Medical and Scientific Imaging

In medical imaging, motion compensation is essential for mitigating artifacts caused by physiological movements such as respiration and cardiac cycles, particularly in magnetic resonance imaging (MRI). Prospective gating techniques synchronize data acquisition with respiratory or cardiac cycles using external monitors or self-navigated signals to avoid motion-corrupted data, enabling high-fidelity imaging of dynamic structures like the heart.^[68] Retrospective motion compensation, in contrast, acquires continuous data and subsequently sorts or registers it based on motion surrogates, allowing for flexible reconstruction of cine sequences without strict real-time synchronization.^[69] These methods have been widely adopted since the early 2000s for clinical cardiac and abdominal MRI, improving diagnostic accuracy by reducing blurring and ghosting artifacts.^[70] Non-rigid registration algorithms, such as the demons method, further enhance MRI by estimating deformable tissue displacements through iterative diffusion-like force fields that align images while preserving anatomical topology.^[71] This approach is particularly effective for respiratory motion in abdominal scans, where organs undergo complex deformations, achieving sub-millimeter accuracy in multi-phase datasets.^[72] In ultrasound imaging, speckle tracking compensates for tissue motion by correlating unique speckle patterns across frames to estimate myocardial strain and displacement, crucial for assessing ventricular function.^[73] Affine models complement this by parameterizing global heart wall translations and rotations, providing robust compensation for probe-induced or patient movements in echocardiography.^[74] In scientific applications, synthetic aperture radar (SAR) employs motion compensation to correct platform instabilities in airborne or spaceborne systems, using phase gradient autofocus or inertial measurement units to refocus images degraded by vibration and trajectory errors.^[75] For satellite imagery, attitude and orbital corrections address earth rotation and attitude jitter, applying geometric transformations to align pushbroom scans and minimize along-track smearing in high-resolution earth observation data.^[76] These techniques extend to 3D volumetric compensation as a foundation for handling spatiotemporal variations in multi-dimensional datasets. Advanced non-rigid methods, including free-form deformations, model tissue motion as a grid of control points warped via B-splines, enabling precise alignment of multimodal images like MRI and CT.^[77] Mutual information serves as a key similarity metric in these registrations, quantifying statistical dependence between images to optimize transformations without assuming intensity linearity, thus supporting robust compensation in heterogeneous tissues.^[78] Recent advancements in 2025 have integrated machine learning for real-time motion compensation in 4D MRI, with frameworks like diffeomorphic flow models enabling unsupervised reconstruction of free-breathing cardiac sequences at accelerated speeds while preserving temporal resolution.^[79] These AI-driven approaches, often building on self-supervised networks, facilitate dynamic 4D imaging for radiation therapy planning by predicting and correcting respiratory patterns in real time.^[80]

Historical Development

Early Concepts and Patents

The origins of motion compensation can be traced to the late 1960s, when researchers began exploring techniques to reduce temporal redundancy in video signals for more efficient transmission, particularly in early television and videophone systems. In analog television contexts, initial ideas for motion prediction emerged as part of efforts to handle frame-to-frame changes during scanning processes.^[81] A pivotal early patent for motion-compensated interframe coding was filed in 1969 by B.G. Haskell and J.O. Limb, introducing the concept of using motion vectors to predict pixel displacements between frames in television pictures, significantly improving coding efficiency over simple frame differencing.^[82]^[83] This invention marked the first practical application of motion compensation to exploit interframe correlations in video signals. Earlier concepts included a 1959 proposal by NHK researchers Y. Taki, M. Hatori, and S. Tanaka for predictive inter-frame video coding. By the 1970s, research advanced these ideas through integration with differential pulse-code modulation (DPCM), where temporal DPCM was enhanced by adding motion compensation to better predict frame differences; a key contribution came in 1979 from Jain and Jain, who formalized motion-compensated temporal DPCM as a foundational structure for video coding.^[84] In the 1980s, Bell Labs researchers proposed digital implementations of motion compensation, including recursive methods for estimating frame-to-frame intensity changes due to object motion, as detailed in their 1980 work on motion-compensated coding techniques. These proposals shifted focus toward digital video, emphasizing block-based estimation to handle complex scenes. Influences from computer vision also emerged, notably the 1981 Lucas-Kanade optical flow method, which provided a differential approach to estimating motion at local image patches and informed subsequent motion estimation algorithms in compensation systems.^[85]^[86]^[87] A significant milestone in early motion compensation research was the 1987 proposal of motion-compensated discrete cosine transform (MC-DCT) coding by Srinivasan and colleagues, which combined block-based motion prediction with DCT for residual error compression, achieving substantial bitrate reductions in videoconferencing applications. This hybrid approach demonstrated up to 50% efficiency gains over non-motion-compensated methods in low-bitrate scenarios. The culmination of these concepts occurred with the adoption of block motion compensation in the CCITT H.261 standard in 1990, which standardized 16x16 macroblock-based prediction for p×64 kbit/s videophone services, marking the transition to practical digital video coding.^[88]^[89]

Evolution in Digital Video Standards

In the 1990s, motion compensation became a cornerstone of digital video standards through its integration with the discrete cosine transform (DCT) in the MPEG family. The MPEG-1 standard, finalized in 1992, introduced block-based motion compensation using 16×16 macroblocks with half-pixel accuracy, enabling efficient prediction of inter-frame differences before DCT quantization for storage and transmission of multimedia content. This MC-DCT hybrid approach reduced temporal redundancy in video sequences, achieving compression ratios suitable for CD-ROM applications. MPEG-2, standardized in 1995, built upon this foundation by supporting scalable profiles, interlaced formats, and bidirectional motion compensation for B-frames, which further improved efficiency for broadcast and DVD applications while maintaining the core 8×8 DCT and half-pel motion vector resolution.^[90] The early 2000s saw refinements in motion compensation with the advent of H.263 and H.264 standards, emphasizing adaptability for low-bitrate and high-efficiency coding. H.263, released in 1996 by ITU-T, extended MPEG foundations with optional modes such as unrestricted motion vectors, allowing references beyond picture boundaries to enhance prediction accuracy in panned or zoomed scenes without introducing artifacts. This feature improved coding efficiency by up to 20% in low-bitrate scenarios compared to prior standards. H.264/AVC, standardized in 2003, advanced these capabilities through weighted prediction in P- and B-slices, which applies adaptive scaling and offsets to reference frames to handle fading or brightness variations, and support for up to 16 multiple reference frames, enabling selection of the most suitable prior frames for more precise motion matching and up to 50% bitrate savings over H.263.^[91] The 2010s introduced more sophisticated motion compensation in HEVC (H.265) and subsequent standards, focusing on larger blocks and diverse prediction options. HEVC, finalized in 2013, expanded inter prediction with up to 35 modes—significantly more than the 9 in H.264—including asymmetric partitioning and advanced motion vector prediction, alongside larger coding units up to 64×64 pixels for better handling of high-resolution content. These enhancements doubled the computational complexity of motion compensation relative to H.264 but delivered approximately 50% greater coding efficiency through reduced bitrate at equivalent quality. Building on this, the Versatile Video Coding (VVC, H.266) standard, completed in 2020, incorporated affine motion models with 4- and 6-parameter representations to capture non-translational motions like rotation and zooming, outperforming translational models by 10-20% in complex scenes.^[92]^[93] By 2025, emerging standards like AV2 from the Alliance for Open Media integrate advanced motion compensation techniques, such as warped motion compensation for complex patterns, drawing from ongoing research on deep learning wrappers around traditional codecs for enhanced frame reconstruction and potential efficiency gains of up to 30% over AV1. Overall, motion compensation has evolved from fixed, translational block matching in early MPEG standards to adaptive, multi-modal systems in modern codecs, prioritizing flexibility for diverse content while balancing complexity and performance.^[94]^[95]

References

[1]
[PDF] Motion Estimation Techniques - Marco Cagnazzo
2D motion vector field: the 2D motion vector field is defined as the projection of the 3D objects motion onto the 2D image plane.<|control11|><|separator|>
[2]
[PDF] new methods for motion estimation with applications to
In this Section, we give a survey of current motion estimation methods. 1.4.1 Motion Search Accuracy. Based on Shannon's coding theorem [15], the coding ...
[3]
A Robust Translational Motion Compensation Method for Moving ...
Sep 24, 2024 · Translational motion compensation constitutes a pivotal and essential procedure in inverse synthetic aperture radar (ISAR) imaging.Missing: offshore | Show results with:offshore
[4]
Motion Compensation in Extremity Cone-Beam CT Using a ... - NIH
We propose a purely image based motion compensation method that requires no fiducials, tracking hardware or prior images. A statistical optimization algorithm ( ...Missing: credible | Show results with:credible
[5]
A Review of Motion Compensation Technology and Application ...
Classification of payload motion compensation methods, Principle of motion compensation, Advantages and disadvantages. Mechanical antiswing technology based ...Missing: definition credible
[6]
Motion Compensation - an overview | ScienceDirect Topics
Motion compensation reduces redundancy by moving image elements based on motion vectors, using motion information to improve video compression efficiency.
[7]
https://ieeexplore.ieee.org/document/1096048
[8]
Video Compression: Principles, Practice, and Standards
– Video contains much spatial and temporal redundancy. • Spatial redundancy: Neighboring pixels are similar. • Temporal redundancy: Adjacent frames are similar.
[9]
A low complexity motion compensated frame interpolation method
Motion compensated frame interpolation (MCFI) techniques are often employed in the decoder to restore the original frame rate and enhance the temporal quality.
[10]
[PDF] Motion Estimation for Video Coding
Motion estimation in video coding uses motion compensation to provide a prediction signal for efficient video compression, relating 3D motion to displacements.
[11]
(PDF) Design of Perspective Affine Motion Compensation for ...
The fundamental motion model of the conventional block-based motion compensation in High Efficiency Video Coding (HEVC) is a translational motion model.Missing: fundamentals | Show results with:fundamentals
[12]
https://ieeexplore.ieee.org/document/313138
[13]
[PDF] Motion estimation and video coding - Digital Commons @ NJIT
Generally, the aperture problem exists in regions of an image that have strongly oriented intensity gradients, say edges. Since the m otion estim ation by.
[14]
H.261 Source Images format
Block Transformation. H261 supports motion compensation in the encoder as an option. In motion compensation a search area is constructed in the previous ...
[15]
[PDF] Analysis of Affine Motion-Compensated Prediction in Video Coding
Jun 19, 2020 · Both models are valid for motion-compensated prediction applied on block- level or on entire frames as in the special case of global motion.Missing: perspective survey
[16]
[PDF] Sprite Coding in Object-based Video Coding Standard: MPEG-4
The algorithm consists of five parts: motion vector calculation, global motion estimation, provisional sprite generation, foreground object extraction and ...
[17]
https://www.intechopen.com/chapters/38726
[18]
https://www.itu.int/rec/T-REC-H.263-199603-S/en
[19]
(PDF) Performance of the H. 263 video compression standard
H.263 achieves approximately 2 dB PSNR gain over H.261 at 64 kbps with minimal complexity increase. Half-pel accuracy in motion compensation significantly ...
[20]
[PDF] Block-Adaptive Interpolation Filter for Sub-Pixel Motion Compensation
Sep 2, 2011 · The proposed block-adaptive interpolation filtering for quarter-pel motion estimation consists of two steps: two-times up-scaling of half-pel ...
[21]
[PDF] Overview of the H.264/AVC video coding standard - Circuits and ...
Variable block-size motion compensation with small block sizes: This standard supports more flexibility in the selection of motion compensation block sizes ...
[22]
[PDF] Rate distortion control in digital video coding - Sign in
Based on the Rate-Distortion (R-D) slope analysis, an operational rate distortion optimization scheme for H.264 using Lagrangian multiplier method is proposed.
[23]
Overlapped Block Motion Compensation: An Estimation-Theoretic ...
Overlapped block motion compensation (OBMC) is formulated as a probabilistic linear estimator of pixel intensities given the limited block motion information ...Missing: MPEG- ASP
[24]
[PDF] A Fast Full Search Scheme for Rate-Distortion Optimization of ...
As for VBS, H.264 supports seven different block sizes with a tree-structured hierarchical MB partitions as shown in Fig. 1 instead of fixed 16x16 block size ...<|control11|><|separator|>
[25]
[PDF] MPEG-4 Natural Video Coding - An overview
MPEG-4 also supports overlapped motion compensation, similar to the one used in H.263. [5]. This usually results in better prediction quality at lower bitrates.
[26]
Motion Compensated Prediction - an overview | ScienceDirect Topics
Motion compensated prediction (MCP) uses motion estimation to predict a current video frame based on a reference frame, improving coding efficiency.
[27]
[PDF] An Overview of Core Coding Tools in the AV1 Video Codec
AV1 uses a 10-way partition tree, 56 intra modes, smooth predictors, and the PAETH predictor, and filter intra modes for luma blocks.
[28]
(PDF) Fast Variable Block Size Motion Estimation for H.264 Using ...
Aug 5, 2025 · In video coding standard H.264/AVC, variable block size mode algorithm improves compression efficiency but has need of a large amount of ...
[29]
A survey of hybrid MC/DPCM/DCT video coding distortions
**Summary of Hybrid MC/DPCM/DCT Framework (Wang et al., 1998)**
[30]
[PDF] Content-Based Motion Compensation and its application to Video ...
Three such motion compensation techniques are described in detail, with one of the methods being integrated into a video codec.Missing: credible | Show results with:credible
[31]
[PDF] MPEG-1 and MPEG-2 Digital Video Coding Standards
Identical to the MPEG-1 standard, the MPEG-2 coding algorithm is based on the general Hybrid DCT/DPCM coding scheme as outlined in. Figure 5, incorporating a ...
[32]
https://bmva-archive.org.uk/theses/2006/2006-servais.pdf
[33]
https://www.di.univr.it/documenti/OccorrenzaIns/matdid/matdid279434.pdf
[34]
[PDF] Dct-based Motion Estimation - SIG@UMD
In Section III, we consider the 2-D translation motion model and extend the DCT pseudophase techniques to the DXT-ME algorithm for application to video coding.
[35]
[PDF] Prediction of DCT Coefficients Considering Motion Compensation ...
Abstract— Current video coding techniques use a Discrete. Cosine Transform (DCT) to reduce spatial correlations within the motion estimation residual.
[36]
[PDF] White Paper: 4x4 Transform and Quantization in H.264/AVC
The 4x4 transform in H.264 is a scaled approximation to a Discrete Cosine Transform (DCT), using a core transform and scaling matrix to minimize complexity.
[37]
H.264/AVC 4x4 Transform and Quantization — Vcodex BV
In H.264, 4x4 blocks use a scaled DCT, then quantization. The process is structured into a core and scaling part to minimize complexity.
[38]
Motion compensation and scalability in lifting-based video coding
This paper focuses on lifting schemes that can be used for the temporal coding part in a motion-compensated temporal-filtering subband coder (MCTF-SBC) for ...
[39]
Video Coding With Motion-Compensated Lifted Wavelet Transforms
Aug 9, 2025 · This paper develops two new adaptive wavelet transforms based on the lifting scheme. The lifting construction exploits a spatial-domain ...
[40]
[PDF] New Temporal Filtering Scheme to Reduce Delay in Wavelet-Based ...
MOTION-COMPENSATED TEMPORAL WAVELET. TRANSFORM USING LIFTING. Lifting allows the incorporation of motion compensation in temporal wavelet transforms while ...<|separator|>
[41]
[PDF] Video Coding Using Motion Compensation
Depending on the motion compensation error, determine the coding mode. (intra, inter-with-no-MC, inter-with-MC, etc.) The original values (for intra mode) or ...
[42]
[PDF] Video Coding with Motion-Compensated Lifted Wavelet Transforms
Jun 3, 2003 · We utilize the Karhunen-Loeve Transform to obtain theoretical perfor- mance bounds at high bit-rates and compare to both optimum intra-frame ...
[43]
Efficient compression of motion-compensated sub-images with ...
Mar 15, 2010 · An approach to highly enhance the compression efficiency of the integral images by applying the Karhunen–Loeve transform (KLT) algorithm to ...
[44]
[PDF] Optimization of 4x4 Integer DCT in H.264/AVC Encoder
Abstract- This paper gives the computation time speed- up improvements obtained for the forward and inverse. 4x4 integer Discrete Cosine Transforms (DCT) in.
[45]
[PDF] A Technical Overview of AV1 - arXiv
This paper provides a technical overview of the AV1 codec design that enables the compression performance gains with considerations for hardware feasibility.
[46]
AV1 Codec - Complete guide for video application devs - ImageKit
Mar 27, 2024 · As per tests conducted by Facebook in 2018, the AV1 reference encoder had 34% and 50% higher data compression than VP9 and H.264, respectively, ...
[47]
H.262 : Information technology - Generic coding of moving pictures and associated audio information: Video
**Summary of Motion Compensation in MPEG-2 (H.262):**
[48]
[PDF] Overview of the MPEG 4 Standard - Sound at MIT edu
• Global motion compensation based on the transmission of a static “sprite”. ... In the area of motion estimation and compensation two new techniques are ...
[49]
[DOC] H26L versus MPEG-4 - ITU
Some MPEG-4 features were disallowed, such as Global Motion Compensation (GMC), Dynamic Resolution Conversion (DRC), B-VOP and OBMC. MPEG-4 software yet ...Missing: 1999 | Show results with:1999
[50]
[PDF] Overview of International Video Coding Standards (preceding H.264 ...
Jul 22, 2005 · H.261: The Basis of Modern Video. Compression. ▫ ITU-T (ex-CCITT) ... • Variable block-size motion compensation. • Intra DCT coefficient ...
[51]
[PDF] ITU-T Rec. H.264 (05/2003) Advanced video coding for generic ...
May 30, 2003 · ... motion compensation with smaller blocks and the quantity of data needed to represent the data for motion compensation. In this ...
[52]
H.265 : High efficiency video coding
**Summary of H.265 (HEVC) on Larger Block Sizes and Merge Modes:**
[53]
Overview of the VP9 video codec | Ronald S. Bultje - GNOME Blogs
Dec 13, 2016 · the compound flag indicates how many references will be used for prediction. · the reference selects which reference(s) is/are used from the ...
[54]
[PDF] Tool Description for AV1 and libaom - Alliance for Open Media
Oct 4, 2021 · Each function block processes the input data using a certain type of video coding technology, and its output is fed into another function block.<|control11|><|separator|>
[55]
[PDF] Design and Implementation of Configurable Motion Estimation ...
This Thesis focuses on motion estimation (ME) that is the main coding tool for removing temporal redundancy of video scenes and it typically accounts for 50 - ...<|separator|>
[56]
[PDF] Performance Comparison of HEVC and H.264/ AVC Standards at ...
According to Jens-Rainer Ohm et al [7] HEVC is aimed at 50% bit rate reduction relative to H.264 standard. The HEVC reference codec is called HEVC Test Model ( ...
[57]
A New Motion Estimation Method for Video Stabilization - IEEE Xplore
Video stabilization is a technology to remove the dithering between frames in a video sequence by motion estimation, motion filter and motion compensation.
[58]
Online motion smoothing for video stabilization via constrained ...
Mar 27, 2017 · The aforementioned constant-velocity Kalman-filtering algorithm effectively smooths the camera motion sequences for online video stabilization.
[59]
Real-Time Video Stabilization Based on Motion Compensation
This paper presents a real-time video stabilization method based on motion compensation for adjusting unstable frames captured by a vibrating camera.
[60]
Video stabilization using robust feature trajectories - IEEE Xplore
Errors are compounded by motion compensation which smoothes motion parameters. This paper proposes a method to directly stabilize a video without explicitly ...
[61]
Exposure to vibrations, like those generated by high-powered ...
With OIS, a gyroscope senses that the camera moved. To reduce image motion, and the resulting blur, the lens moves according to the angle of the gyroscope.Missing: smartphones | Show results with:smartphones
[62]
Video Frame Interpolation: A Comprehensive Survey
Optical flow can perceive motion information in continuous frames and capture dense pixel correspondence. The optical flow directs the warping process, which ...<|separator|>
[63]
Motion Compensated Frame Interpolation with a Symmetric Optical ...
We consider the problem of interpolating frames in an image sequence. For this purpose accurate motion estimation can be very helpful.
[64]
[PDF] Frame-Recurrent Video Super-Resolution - CVF Open Access
Recent advances in video super-resolution have shown that convolutional neural networks combined with motion compensation are able to merge information from ...
[65]
Video super-resolution using motion compensation and residual ...
In our method, motion compensation and bidirectional residual convolutional network are combined to model the spatial and temporal non-linear mappings.
[66]
New motion-compensation approach delivers sharper single-pixel ...
Sep 10, 2025 · Most existing approaches for single-pixel imaging motion compensation are not well-suited to dynamic scenes, especially those with complex ...
[67]
Prospective gating control for highly efficient cardio-respiratory ...
This paper reports the development of prospective gating techniques for cardiac and respiratory motion desensitised MRI with significantly reduced minimum scan ...
[68]
Reconstruction techniques for cardiac cine MRI | Insights into Imaging
Sep 23, 2019 · Thus, free-breathing (FB) acquisition procedures, with retrospective respiratory gating and motion estimation and compensation (ME-MC) ...
[69]
Retrospective cardiac gating: A review of technical aspects and ...
In this paper, technical details of the data collection and image reconstruction process for cine MRI using retrospective cardiac gating are presented.Missing: prospective | Show results with:prospective
[70]
Balanced multi-image demons for non-rigid registration of magnetic ...
Sep 20, 2020 · A new approach is introduced for non-rigid registration of a pair of magnetic resonance images (MRI). It is a generalization of the demons ...
[71]
Balanced multi-image demons for non-rigid registration of magnetic ...
A new approach is introduced for non-rigid registration of a pair of magnetic resonance images (MRI). It is a generalization of the demons algorithm with ...
[72]
An optimisation-based iterative approach for speckle tracking ...
Apr 7, 2020 · Speckle tracking is the most prominent technique used to estimate the regional movement of the heart based on echocardiograms.
[73]
[PDF] High-frame-rate speckle tracking echocardiography - HAL
Par- ametric models could be integrated to potentially improve motion estimation, such as those assuming locally affine motions [36]. In particular, this ...
[74]
Motion Compensation on Range Doppler Algorithm for Airborne SAR
This paper studies the single step Motion compensation (MOCO) algorithm and its effectiveness in eliminating the defocusing effects on Synthetic Aperture Radar ...
[75]
Study of the image motion compensation method for a vertical orbit ...
Nov 28, 2023 · Finally, satellite attitude control and line frequency matching are used as compensation methods, and the image motion compensation amount is ...
[76]
Nonrigid registration using free-form deformations - PubMed
In this paper we present a new approach for the nonrigid registration of contrast-enhanced breast MRI. A hierarchical transformation model of the motion of ...Missing: compensation | Show results with:compensation
[77]
Non-rigid image registration using mutual information - SpringerLink
Recent research in the field has focused on extending the mutual information based registration criterion to non-rigid matching, which is complicated by the ...Missing: compensation | Show results with:compensation
[78]
Motion-compensated recovery using diffeomorphic flow (DMoCo) for ...
Jun 2, 2025 · We introduce an unsupervised motion-compensated image reconstruction algorithm for free-breathing and ungated 5D functional cardiac magnetic ...
[79]
An open‐source deep learning framework for respiratory motion ...
Jul 15, 2025 · To address the need for inexpensive real-time IGRT, we developed Voxelmap, a deep learning framework that achieves 3D respiratory motion ...
[80]
Flying Spot Scanner TV Camera - Early Television Museum
A working flying spot scanner camera using the RCA Photocell Cabinet. Visitors to the museum can see their friends as they would have appeared on mechanical ...
[81]
Motion Compensation - an overview | ScienceDirect Topics
The purpose of motion compensation is to reduce the echo error caused by irregular motion through control or correction measures.
[82]
[DOC] Personal Header - ITU
Jul 26, 2002 · ... Ninomiya and Ohtsuka 1982 [III-53] described an iterative procedure ... motion-compensated interframe prediction and intraframe prediction.
[83]
[PDF] Origins of the performance of H.264/AVC: an account of the ...
The structure was significantly enhanced in 1979 by Jain and Jain, who added motion compensation to the temporal DPCM [2]. This is the basic form used by ...
[84]
https://ptacts.uspto.gov/ptacts/public-informations/petitions/1556179/download-documents?artifactId=3Ezbp0syf2fQM-_b-zfZZFhXOsjosLGKqbR0jRsXqHKViEZe8t5P3gg
[85]
Recursive Motion Compensation: A Review - SpringerLink
We present algorithms for estimating frame-to-frame changes in intensity of a television scene. The changes can be a result of object motion in a TV scene ...
[86]
[PDF] Lucas-Kanade 20 Years On: A Unifying Framework Part 1
Since the Lucas-Kanade algorithm was proposed in 1981 image alignment has be- come one of the most widely used techniques in computer vision.
[87]
Motion-Compensated Coder for Videoconferencing - NASA ADS
The motion estimation algorithm employed is simple and reduces temporal redundancy, while the CMT reduces spatial redundancy in the transmitted prediction ...
[88]
https://ui.adsabs.harvard.edu/abs/1987ITCom..35..297S/abstract
[89]
https://www.itu.int/rec/dologin_pub.asp?lang=e&id=T-REC-H.261-199012-S!!PDF-E&type=items
[90]
https://ieeexplore.ieee.org/document/501769
[91]
Impact of Video Motion Content on HEVC Coding Efficiency - MDPI
Aug 18, 2024 · HEVC has better support for high-resolution video, including 4K and 8K resolutions. Additionally, HEVC supports a wider range of bit depths, ...
[92]
Analysis of Affine Motion-Compensated Prediction in Video Coding
Jun 17, 2020 · In this work, a model for affine motion-compensated prediction in video coding is derived. Using the rate-distortion theory and the displacement ...
[93]
AOMedia Research Symposium 2019 | Alliance for Open Media
Oct 14, 2019 · ... Motion Compensated Prediction (05) ... Deep Neural Network Based Frame Reconstruction For Optimized Video Coding – An AV2 Approach (18) ...Missing: proposals | Show results with:proposals<|separator|>