TY - JOUR T1 - IMU-Guided Adaptive Video Stabilization for Unmanned Surface Vehicles TT - İNSANSIZ DENİZ ARAÇLARI (İDA) İÇİN IMU REHBERLİ VE UYARLANABİLİR VİDEO STABİLİZASYONU AU - Akdoğan, Cüneyd Murabıt AU - Kıran, Mustafa Servet PY - 2026 DA - November Y2 - 2026 DO - 10.56850/jnse.2016708 JF - Journal of Naval Sciences and Engineering JO - JNSE PB - Millî Savunma Üniversitesi WT - DergiPark SN - 1304-2025 SP - 449 EP - 470 IS - Advanced Online Publication LA - en AB - This study addresses the critical challenge of video stabilization in Unmanned Surface Vehicles (USVs) operating under high-wave and harsh maritime conditions. Conventional stabilization methods often struggle to distinguish erratic vessel motions caused by waves from intentional camera maneuvers, leading to significant image distortion, horizon tilt, and loss of visual data. To overcome this, we propose a novel hybrid stabilization framework that fuses Inertial Measurement Unit (IMU) data with Optical Flow analysis. Unlike traditional fusion techniques, the core innovation of this approach is using IMU data strictly as a control signal to guide the stabilization process, rather than as a direct geometric warping tool. A key contribution of the proposed method is the implementation of an adaptive α (alpha) coefficient, which dynamically adjusts the weighting between inertial data and visual cues based on the instantaneous dynamics and motion intensity of the marine vehicle. This adaptive mechanism allows the algorithm to effectively suppress high-frequency jitter and wave-induced oscillations while preserving the integrity of intentional navigation maneuvers along the cruise path. Experimental results demonstrate that the proposed method significantly reduces unwanted vibrations and improves visual clarity compared to baseline stabilization models. The findings suggest that the IMU-guided adaptive approach provides a robust and computationally efficient solution for real-time perception and situational awareness in autonomous maritime systems. The source code and trained model generated in this study are publicly available at: https://github.com/KTUN-Institute-Works/acc_flow KW - Unmanned Surface Vehicles (USV) KW - Video Stabilization KW - Sensor Fusion KW - IMU KW - Optical Flow KW - Adaptive Control KW - Image Processing N2 - Bu çalışma yüksek dalga ve zorlu deniz koşullarında görev yapan İnsansız Deniz Araçlarında (İDA) video stabilizasyonu konusundaki kritik zorlukları ele almaktadır. Geleneksel stabilizasyon yöntemleri, dalgalardan kaynaklanan düzensiz tekne hareketleri ile kasıtlı kamera manevralarını ayırt etmekte sıklıkla zorlanmakta ve bu durum ciddi görüntü bozulmalarına, ufuk çizgisi kaymalarına ve görsel veri kaybına yol açmaktadır. Bu sorunun üstesinden gelmek için Eylemsizlik Ölçüm Birimi (IMU) verilerini Optik Akış analizi ile birleştiren özgün bir hibrit stabilizasyon çerçevesi önerilmektedir. Geleneksel füzyon tekniklerinden farklı olarak bu yaklaşımın temel yeniliği IMU verilerinin doğrudan bir geometrik düzeltme aracı yerine stabilizasyon sürecini yönlendiren bir kontrol sinyali olarak kullanılmasıdır. Önerilen yöntemin temel katkısı, deniz aracının anlık dinamiklerine ve hareket yoğunluğuna bağlı olarak ataletsel veriler ile görsel ipuçları arasındaki ağırlığı dinamik olarak ayarlayan adaptif bir α (alfa) katsayısının uygulanmasıdır. Bu uyarlanabilir mekanizma algoritmanın rotadaki kasıtlı seyrin bütünlüğünü korurken deniz dalgalanmalarının neden olduğu yüksek frekanslı titreşimleri ve yalpalamaları etkili bir şekilde bastırmasına olanak tanır. Deneysel sonuçlar, önerilen yöntemin temel alınan stabilizasyon modellerine kıyasla istenmeyen sarsıntıları önemli ölçüde azalttığını ve görsel netliği artırdığını kanıtlamaktadır. Bulgular IMU rehberli adaptif yaklaşımın otonom deniz sistemlerinde gerçek zamanlı algılama ve çevresel farkındalık için sağlam ve hesaplama açısından verimli bir çözüm sunduğuna işaret etmektedir. Bu çalışmada geliştirilen kaynak kodlarına ve eğitilmiş modele https://github.com/KTUN-Institute-Works/acc_flow adresinden erişim sağlanabilir. CR - Y. Wang, Q. Huang, C. Jiang, J. Liu, M. Shang, and Z. Miao, “Video stabilization: A comprehensive survey,” Neurocomputing, vol. 516, pp. 205–230, Jan. 2023, doi: 10.1016/j.neucom.2022.10.008. CR - Z. Teed and J. Deng, “RAFT: Recurrent All-Pairs Field Transforms for Optical Flow,” in Computer Vision – ECCV 2020, vol. 12347, A. Vedaldi, H. Bischof, T. Brox, and J.-M. Frahm, Eds., in Lecture Notes in Computer Science, vol. 12347. , Cham: Springer International Publishing, 2020, pp. 402–419. doi: 10.1007/978-3-030-58536-5_24. CR - J. Auysakul, H. Xu, and V. Pooneeth, “A Hybrid Motion Estimation for Video Stabilization Based on an IMU Sensor,” Sensors, vol. 18, no. 8, p. 2708, Aug. 2018, doi: 10.3390/s18082708. CR - H. Li, K. Luo, and S. Liu, “GyroFlow: Gyroscope-Guided Unsupervised Optical Flow Learning,” in 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada: IEEE, Oct. 2021, pp. 12849–12858. doi: 10.1109/ICCV48922.2021.01263. CR - J. Yu, T. Zhang, F. Shi, L. He, and C.-K. Liang, “SensorFlow: Sensor and Image Fused Video Stabilization,” in 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Tucson, AZ, USA: IEEE, 2025. CR - B. D. Lucas and T. Kanade, “An Iterative Image Registration Technique with an Application to Stereo Vision,” in Proceedings of the 7th International Joint Conference on Artificial Intelligence (IJCAI), Vancouver, BC, Canada, 1981, pp. 674–679. CR - R. Hartley and A. Zisserman, Multiple view geometry in computer vision, 2. edition, 17.printing. Cambridge: Cambridge Univ. Press, 2018. CR - M. Grundmann, V. Kwatra, and I. Essa, “Auto-directed video stabilization with robust L1 optimal camera paths,” in CVPR 2011, Colorado Springs, CO, USA: IEEE, Jun. 2011, pp. 225–232. doi: 10.1109/CVPR.2011.5995525. CR - T. Brox, A. Bruhn, N. Papenberg, and J. Weickert, “High Accuracy Optical Flow Estimation Based on a Theory for Warping,” in Computer Vision - ECCV 2004, vol. 3024, T. Pajdla and J. Matas, Eds., in Lecture Notes in Computer Science, vol. 3024. , Berlin, Heidelberg: Springer Berlin Heidelberg, 2004, pp. 25–36. doi: 10.1007/978-3-540-24673-2_3. CR - H. Shen, Q. Pan, Y. Cheng, and Y. Yu, “Fast video stabilization algorithm for UAV,” in 2009 IEEE International Conference on Intelligent Computing and Intelligent Systems, Shanghai, China: IEEE, Nov. 2009, pp. 542–546. doi: 10.1109/ICICISYS.2009.5357609. CR - P. Sand and S. Teller, “Particle Video: Long-Range Motion Estimation Using Point Trajectories,” Int. J. Comput. Vis., vol. 80, no. 1, pp. 72–91, Oct. 2008, doi: 10.1007/s11263-008-0136-6. CR - Y. Matsushita, E. Ofek, W. Ge, X. Tang, and H.-Y. Shum, “Full-frame video stabilization with motion inpainting,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 7, pp. 1150–1163, Jul. 2006, doi: 10.1109/TPAMI.2006.141. CR - A. Lim, B. Ramesh, Y. Yang, C. Xiang, Z. Gao, and F. Lin, “Real-Time Optical flow-based Video Stabilization for Unmanned Aerial Vehicles,” Jan. 13, 2017, arXiv: arXiv:1701.03572. doi: 10.48550/arXiv.1701.03572. CR - S. Liu, L. Yuan, P. Tan, and J. Sun, “Bundled camera paths for video stabilization,” ACM Trans. Graph., vol. 32, no. 4, pp. 1–10, Jul. 2013, doi: 10.1145/2461912.2461995. CR - Y. Xu, J. Zhang, S. J. Maybank, and D. Tao, “DUT: Learning Video Stabilization by Simply Watching Unstable Videos,” Jun. 09, 2022, arXiv: arXiv:2011.14574. doi: 10.48550/arXiv.2011.14574. CR - L. Karacan and M. Sarıgül, “Full-Frame Video Stabilization via Spatiotemporal Transformers,” Comput. Vis. Media, vol. 11, no. 3, pp. 655–667, Jun. 2025, doi: 10.26599/CVM.2025.9450416. CR - Z. Li, T. Zhuo, Y. Cao, J. Yu, and Y. Liu, “TranStable: Towards Robust Pixel-level Online Video Stabilization by Jointing Transformer and CNN,” Jan. 25, 2025, arXiv: arXiv:2501.15138. doi: 10.48550/arXiv.2501.15138. CR - M. K. Ali et al., “Harnessing Meta-Learning for Controllable Full-Frame Video Stabilization,” Aug. 26, 2025, arXiv: arXiv:2508.18859. doi: 10.48550/arXiv.2508.18859. CR - S. Leutenegger, S. Lynen, M. Bosse, R. Siegwart, and P. Furgale, “Keyframe-based visual–inertial odometry using nonlinear optimization,” Int. J. Robot. Res., vol. 34, no. 3, pp. 314–334, Mar. 2015, doi: 10.1177/0278364914554813. CR - J. Shi and C. Tomasi, “Good features to track,” in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94, Seattle, WA, USA: IEEE Comput. Soc. Press, 1994, pp. 593–600. doi: 10.1109/CVPR.1994.323794. CR - M. Wang et al., “Deep Online Video Stabilization With Multi-Grid Warping Transformation Learning,” IEEE Trans. Image Process., vol. 28, no. 5, pp. 2283–2292, May 2019, doi: 10.1109/TIP.2018.2884280. CR - Z. Zhang, Z. Liu, P. Tan, B. Zeng, and S. Liu, “Minimum Latency Deep Online Video Stabilization,” in 2023 IEEE/CVF International Conference on Computer Vision (ICCV), Paris, France: IEEE, Oct. 2023. CR - J. Choi and I. S. Kweon, “Deep Iterative Frame Interpolation for Full-frame Video Stabilization,” ACM Trans. Graph., vol. 39, no. 1, pp. 1–9, Feb. 2020, doi: 10.1145/3363550. UR - https://doi.org/10.56850/jnse.2016708 L1 - https://dergipark.org.tr/en/download/article-file/6329824 ER -