Araştırma Makalesi
BibTex RIS Kaynak Göster

Keyframe Extraction Using Linear Rotation Invariant Coordinates

Yıl 2022, , 1040 - 1051, 20.10.2022
https://doi.org/10.16984/saufenbilder.1148511

Öz

Keyframe extraction is a widely applied remedy for issues faced with 3D motion capture -based computer animation. In this paper, we propose a novel keyframe extraction method, where the motion is represented in linear rotation invariant coordinates and the dimensions covering 95% of the data are automatically selected using principal component analysis. Then, by K-means classification, the summarized data is clustered and a keyframe is extracted from each cluster based on cosine similarity. To validate the method, an online user study was conducted. The results of the user study show that 45% of the participants preferred the keyframes extracted using the proposed method, outperforming the alternative by 6%.

Kaynakça

  • [1] Y. Lipman, O. Sorkine, D. Levin, D. Cohen-Or, “Linear rotation-invariant coordinates for meshes” ACM Transactions on Graphics, vol. 24, no. 3, p. 479–487, jul 2005.
  • [2] A. Mackiewicz, W. Ratajczak, “Principal components analysis (pca)” Computers & Geosciences, vol. 19, no. 3, pp. 303–342, 1993.
  • [3] S. Lloyd, “Least squares quantization in pcm,” IEEE Transactions on Information Theory, vol. 28, no. 2, pp. 129–137, 1982.
  • [4] M. Kapadia, I.-k. Chiang, T. Thomas, N. I. Badler, J. T. Kider, “Efficient motion retrieval in large motion databases,” in Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, ser. I3D ’13. New York, NY, USA: Association for Computing Machinery, 2013, p. 19–28.
  • [5] C. Jin, T. Fevens, S. Mudur, “Optimized keyframe extraction for 3d character animations,” Computer Animation and Virtual Worlds, vol. 23, no. 6, pp. 559–568, 2012.
  • [6] A. Voulodimos, I. Rallis, N. Doulamis, “Physics-based keyframe selection for human motion summarization,” Multimedia Tools and Applications, vol. 79, no. 5, pp. 3243–3259, 2020.
  • [7] T. Sapinski, D. Kaminska, A. Pelikant, G. Anbarjafari, “Emotion recognition from skeletal movements,” Entropy, vol. 21, no. 7, 2019.
  • [8] G. Xia, H. Sun, X. Niu, G. Zhang, L. Feng, “Keyframe extraction for human motion capture data based on joint kernel sparse representation,” IEEE Transactions on Industrial Electronics, vol. 64, no. 2, pp. 1589–1599, 2017.
  • [9] W. Choensawat, M. Nakamura, K. Hachimura, “Genlaban: A tool for generating labanotation from motion capture data,” Multimedia Tools and Applications, vol. 74, no. 23, pp. 10823-10846, 2015.
  • [10] T. Miura, T. Kaiga, N. Matsumoto, H. Katsura, K. Tajima, H. Tamamoto, “Application of the bayesian information criterion to keyframe extraction from motion capture data,” in SIGGRAPH Asia 2011 Posters, ser. SA ’11. New York, NY, USA: Association for Computing Machinery, 2011.
  • [11] E. Bulut, T. Capin, “Key frame extraction from motion capture data by curve saliency,” CASA, 2007.
  • [12] H. Togawa, M. Okuda, “Position-based keyframe selection for human motion animation,” in 11th International Conference on Parallel and Distributed Systems (ICPADS’05), vol. 2, 2005, pp. 182–185
  • [13] Y. Yang, L. Zeng, H. Leung, “Keyframe extraction from motion capture data for visualization,” in 2016 International Conference on Virtual Reality and Visualization (ICVRV), 2016, pp. 154–157.
  • [14] Q. Zhang, X. Xue, D. Zhou, X. Wei, “Motion key-frames extraction based on amplitude of distance characteristic curve,” International Journal of Computational Intelligence Systems, vol. 7, no. 3, pp. 506–514, 2014.
  • [15] C. Halit, T. Capin, “Multiscale motion saliency for keyframe extraction from motion capture sequences,” Computer Animation and Virtual Worlds, vol. 22, no. 1, pp. 3–14, 2011.
  • [16] R. Roberts, J. P. Lewis, K. Anjyo, J. Seo, Y. Seol, “Optimal and interactive keyframe selection for motion capture,” in SIGGRAPH Asia 2018 Technical Briefs, ser. SA ’18. New York, NY, USA: Association for Computing Machinery, 2018.
  • [17] B. Sun, D. Kong, S. Wang, J. Li, “Keyframe extraction for human motion capture data based on affinity propagation,” in 2018 IEEE 9th Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON), 2018, pp. 107–112.
  • [18] Q. Zhang, S.-P. Yu, D.-S. Zhou, X.-P. Wei, “An efficient method of key-frame extraction based on a cluster algorithm,” Journal of Human Kinetics, vol. 39, no. 1, pp. 5–14, 2013.
  • [19] K.-S. Huang, C.-F. Chang, Y.-Y. Hsu, S.-N. Yang, “Key probe: A technique for animation keyframe extraction,” The Visual Computer, vol. 21, pp. 532–541, 2005.
  • [20] Q. Zhang, S. Zhang, D. Zhou, “Keyframe extraction from human motion capture data based on a multiple population genetic algorithm,” Symmetry, vol. 6, pp. 926–937, 2014.
  • [21] X.-m. Liu, A.-m. Hao, D. Zhao, “Optimization-based key frame extraction for motion capture animation,” The Visual Computer, vol. 29, 2012.
  • [22] M. Müller, T. Röder, M. Clausen, B. Eberhardt, B. Krüger, A. Weber, “Documentation mocap database hdm05,” Universität Bonn, Tech. Rep. CG-2007-2, 2007.
Yıl 2022, , 1040 - 1051, 20.10.2022
https://doi.org/10.16984/saufenbilder.1148511

Öz

Kaynakça

  • [1] Y. Lipman, O. Sorkine, D. Levin, D. Cohen-Or, “Linear rotation-invariant coordinates for meshes” ACM Transactions on Graphics, vol. 24, no. 3, p. 479–487, jul 2005.
  • [2] A. Mackiewicz, W. Ratajczak, “Principal components analysis (pca)” Computers & Geosciences, vol. 19, no. 3, pp. 303–342, 1993.
  • [3] S. Lloyd, “Least squares quantization in pcm,” IEEE Transactions on Information Theory, vol. 28, no. 2, pp. 129–137, 1982.
  • [4] M. Kapadia, I.-k. Chiang, T. Thomas, N. I. Badler, J. T. Kider, “Efficient motion retrieval in large motion databases,” in Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, ser. I3D ’13. New York, NY, USA: Association for Computing Machinery, 2013, p. 19–28.
  • [5] C. Jin, T. Fevens, S. Mudur, “Optimized keyframe extraction for 3d character animations,” Computer Animation and Virtual Worlds, vol. 23, no. 6, pp. 559–568, 2012.
  • [6] A. Voulodimos, I. Rallis, N. Doulamis, “Physics-based keyframe selection for human motion summarization,” Multimedia Tools and Applications, vol. 79, no. 5, pp. 3243–3259, 2020.
  • [7] T. Sapinski, D. Kaminska, A. Pelikant, G. Anbarjafari, “Emotion recognition from skeletal movements,” Entropy, vol. 21, no. 7, 2019.
  • [8] G. Xia, H. Sun, X. Niu, G. Zhang, L. Feng, “Keyframe extraction for human motion capture data based on joint kernel sparse representation,” IEEE Transactions on Industrial Electronics, vol. 64, no. 2, pp. 1589–1599, 2017.
  • [9] W. Choensawat, M. Nakamura, K. Hachimura, “Genlaban: A tool for generating labanotation from motion capture data,” Multimedia Tools and Applications, vol. 74, no. 23, pp. 10823-10846, 2015.
  • [10] T. Miura, T. Kaiga, N. Matsumoto, H. Katsura, K. Tajima, H. Tamamoto, “Application of the bayesian information criterion to keyframe extraction from motion capture data,” in SIGGRAPH Asia 2011 Posters, ser. SA ’11. New York, NY, USA: Association for Computing Machinery, 2011.
  • [11] E. Bulut, T. Capin, “Key frame extraction from motion capture data by curve saliency,” CASA, 2007.
  • [12] H. Togawa, M. Okuda, “Position-based keyframe selection for human motion animation,” in 11th International Conference on Parallel and Distributed Systems (ICPADS’05), vol. 2, 2005, pp. 182–185
  • [13] Y. Yang, L. Zeng, H. Leung, “Keyframe extraction from motion capture data for visualization,” in 2016 International Conference on Virtual Reality and Visualization (ICVRV), 2016, pp. 154–157.
  • [14] Q. Zhang, X. Xue, D. Zhou, X. Wei, “Motion key-frames extraction based on amplitude of distance characteristic curve,” International Journal of Computational Intelligence Systems, vol. 7, no. 3, pp. 506–514, 2014.
  • [15] C. Halit, T. Capin, “Multiscale motion saliency for keyframe extraction from motion capture sequences,” Computer Animation and Virtual Worlds, vol. 22, no. 1, pp. 3–14, 2011.
  • [16] R. Roberts, J. P. Lewis, K. Anjyo, J. Seo, Y. Seol, “Optimal and interactive keyframe selection for motion capture,” in SIGGRAPH Asia 2018 Technical Briefs, ser. SA ’18. New York, NY, USA: Association for Computing Machinery, 2018.
  • [17] B. Sun, D. Kong, S. Wang, J. Li, “Keyframe extraction for human motion capture data based on affinity propagation,” in 2018 IEEE 9th Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON), 2018, pp. 107–112.
  • [18] Q. Zhang, S.-P. Yu, D.-S. Zhou, X.-P. Wei, “An efficient method of key-frame extraction based on a cluster algorithm,” Journal of Human Kinetics, vol. 39, no. 1, pp. 5–14, 2013.
  • [19] K.-S. Huang, C.-F. Chang, Y.-Y. Hsu, S.-N. Yang, “Key probe: A technique for animation keyframe extraction,” The Visual Computer, vol. 21, pp. 532–541, 2005.
  • [20] Q. Zhang, S. Zhang, D. Zhou, “Keyframe extraction from human motion capture data based on a multiple population genetic algorithm,” Symmetry, vol. 6, pp. 926–937, 2014.
  • [21] X.-m. Liu, A.-m. Hao, D. Zhao, “Optimization-based key frame extraction for motion capture animation,” The Visual Computer, vol. 29, 2012.
  • [22] M. Müller, T. Röder, M. Clausen, B. Eberhardt, B. Krüger, A. Weber, “Documentation mocap database hdm05,” Universität Bonn, Tech. Rep. CG-2007-2, 2007.
Toplam 22 adet kaynakça vardır.

Ayrıntılar

Birincil Dil İngilizce
Konular Matematik
Bölüm Araştırma Makalesi
Yazarlar

Hasan Mutlu Bu kişi benim 0000-0001-8686-6988

Ufuk Çelikcan 0000-0001-6421-185X

Yayımlanma Tarihi 20 Ekim 2022
Gönderilme Tarihi 25 Temmuz 2022
Kabul Tarihi 5 Eylül 2022
Yayımlandığı Sayı Yıl 2022

Kaynak Göster

APA Mutlu, H., & Çelikcan, U. (2022). Keyframe Extraction Using Linear Rotation Invariant Coordinates. Sakarya University Journal of Science, 26(5), 1040-1051. https://doi.org/10.16984/saufenbilder.1148511
AMA Mutlu H, Çelikcan U. Keyframe Extraction Using Linear Rotation Invariant Coordinates. SAUJS. Ekim 2022;26(5):1040-1051. doi:10.16984/saufenbilder.1148511
Chicago Mutlu, Hasan, ve Ufuk Çelikcan. “Keyframe Extraction Using Linear Rotation Invariant Coordinates”. Sakarya University Journal of Science 26, sy. 5 (Ekim 2022): 1040-51. https://doi.org/10.16984/saufenbilder.1148511.
EndNote Mutlu H, Çelikcan U (01 Ekim 2022) Keyframe Extraction Using Linear Rotation Invariant Coordinates. Sakarya University Journal of Science 26 5 1040–1051.
IEEE H. Mutlu ve U. Çelikcan, “Keyframe Extraction Using Linear Rotation Invariant Coordinates”, SAUJS, c. 26, sy. 5, ss. 1040–1051, 2022, doi: 10.16984/saufenbilder.1148511.
ISNAD Mutlu, Hasan - Çelikcan, Ufuk. “Keyframe Extraction Using Linear Rotation Invariant Coordinates”. Sakarya University Journal of Science 26/5 (Ekim 2022), 1040-1051. https://doi.org/10.16984/saufenbilder.1148511.
JAMA Mutlu H, Çelikcan U. Keyframe Extraction Using Linear Rotation Invariant Coordinates. SAUJS. 2022;26:1040–1051.
MLA Mutlu, Hasan ve Ufuk Çelikcan. “Keyframe Extraction Using Linear Rotation Invariant Coordinates”. Sakarya University Journal of Science, c. 26, sy. 5, 2022, ss. 1040-51, doi:10.16984/saufenbilder.1148511.
Vancouver Mutlu H, Çelikcan U. Keyframe Extraction Using Linear Rotation Invariant Coordinates. SAUJS. 2022;26(5):1040-51.

30930 This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.