Title page for 975202086


[Back to Results | New Search]

Student Number 975202086
Author Shih-yao Wei(魏士堯)
Author's Email Address No Public.
Statistics This thesis had been viewed 735 times. Download 305 times.
Department Computer Science and Information Engineering
Year 2009
Semester 2
Degree Master
Type of Document Master's Thesis
Language zh-TW.Big5 Chinese
Title Design and Implementation of a Real-time Continuous Image Mosaic System
Date of Defense 2010-07-22
Page Count 116
Keyword
  • distortion correction
  • FPGA
  • image mosaic
  • image stitching
  • real-time system
  • video surveillance
  • Abstract Because of the limited vision, a single lens is not appropriate for video surveillance applications in wide-angle vision. Based on the usage of dual cameras, a real-time continuous images mosaic system which is suitable for wide-angle monitoring is proposed in this study. The system can provide satisfactory real-time streaming video performance while ensuring the continuity of bonding area.
    To reduce the computational burden, the complex image bonding procedure is divided into off-line calibration and image stitching phases. In addition, a regional distortion model for calibrating non-radial distortion images is developed. Moreover, the ghost image of overlapping region is removed by a new measure. Finally, both the one-time interpolation approach proposed in this study and the discrete wavelet transform can significantly improve image quality and system efficiency.
    The system software has been verified in a personal desktop and an embedded NIOS processor, followed by an analysis of the execution time of each software module to identify and resolve system bottlenecks. The software module is then synthesized into a hardware circuit module by the MIAT hardware synthesis methodology and verified on a FPGA(Field-Programmable Gate Array).
    The module verifications and experimental results show that the proposed system can provide a high-quality and high-performance solution, even in the case of moving objects.
    Table of Content 摘要i
    Abstractii
    目錄iii
    圖目錄vii
    表目錄xi
    第一章 緒論1
    1.1 研究動機1
    1.2 文獻回顧1
    1.2.1 環場影像建構2
    1.2.2 鏡頭扭曲校正3
    1.2.3 影像接合5
    1.3 系統流程9
    1.4 論文架構10
    第二章 影像接合相關研究11
    2.1 概述11
    2.2 柱狀投影12
    2.3 平面轉換14
    2.4 角點特徵擷取16
    2.5 特徵匹配19
    2.5.1 鄰近區域相似比對19
    2.5.2 一致性隨機取樣19
    2.6 影像融合21
    2.6.1 亮度一致化21
    2.6.2 重疊區域影像混合22
    第三章 影像校正24
    3.1 影像扭曲校正24
    3.1.1 多項式扭曲模型25
    3.1.2 區域性校正扭曲模型28
    3.2 平面投影轉換30
    3.3 求解轉換參數32
    3.3.1 多項式扭曲模型參數33
    3.3.2 平面投影轉換矩陣34
    3.4 建立轉換對照表35
    第四章 影像接合36
    4.1 影像插補37
    4.2 重疊區域移動物偏移量38
    4.2.1 建立背景模型39
    4.2.2 建立移動物區域41
    4.2.3 特徵擷取比對44
    4.3 區域性影像混合47
    4.4 即時需求演算法改良49
    4.4.1 一次性影像插補50
    4.4.2 離散小波轉換51
    第五章 嵌入式硬體實作54
    5.1 高階系統硬體設計方法論54
    5.2 系統架構與分析58
    5.3 離散雙線性內插62
    5.4 整數化影像灰階值轉換66
    5.5 區域性影像混合68
    5.6 背景模型70
    5.7 高速侵蝕與膨脹模組73
    第六章 系統實作與實驗結果78
    6.1 實驗設備與開發環境78
    6.2 影像接合系統實作與驗證79
    6.2.1 靜態影像接合79
    6.2.2 即時連續影像接合81
    6.3 系統效能分析86
    6.3.1 演算法效能分析86
    6.3.2 硬體模組驗證與效能分析87
    6.4 扭曲校正與影像插補實驗89
    6.5 系統比較92
    第七章 結論與未來研究方向95
    7.1 結論95
    7.2 未來研究方向96
    參考文獻97
    Reference [1] Kyoungju Park; Seungju Bang, "Motion estimation during photographing towards minimal solution for mobile panoramic images," Consumer Electronics, IEEE Transactions on , vol.54, no.3, pp.992-998, August 2008.
    [2] Seong Jong Ha; Hyung Koo; Sang Hwa Lee; Nam Ik Cho; Soo Kyun Kim, "Panorama Mosaic Optimization for Mobile Camera Systems," Consumer Electronics, IEEE Transactions on , vol.53, no.4, pp.1217-1225, Nov. 2007.
    [3] Seong Jong Ha; Sang Hwa Lee; Nam Ik Cho; Soo Kyun Kim; Byungjun Son, "Embedded Panoramic Mosaic System Using Auto-Shot Interface," Consumer Electronics, IEEE Transactions on , vol.54, no.1, pp.16-24, February 2008.
    [4] R. Szeliski; H. Shum, "Creating Full View Panoramic Image Mosaics and Environment Maps," 1997.
    [5] 黃禎福, "環場影像接合之研究," 國立台灣大學資訊工程學系碩士學位論文, 2002.
    [6] Panli He; Xiaowei Han; Tianmin Deng, "A new method of color image mosaic," Intelligent Control and Automation, 2008. WCICA 2008. 7th World Congress on , vol., no., pp.7757-7761, 25-27 June 2008.
    [7] Brown, M.; Lowe, D.G., "Recognising panoramas," Computer Vision, 2003. Proceedings. Ninth IEEE International Conference on , vol., no., pp.1218-1225 vol.2, 13-16 Oct. 2003.
    [8] F. Devernay; O. Faugeras, "Straight Lines Have to Be Straight, " IN SPIE, VOLUME 2567, vol. 2567, 2001.
    [9] Stein, G.P., "Lens distortion calibration using point correspondences," Computer Vision and Pattern Recognition, 1997. Proceedings., 1997 IEEE Computer Society Conference on , vol., no., pp.602-608, 17-19 Jun 1997.
    [10] 許捷皓, "運用校正板與鏡頭光學參數的內視鏡影像校正法,"中原大學電子工程學系碩士學位論文, 2004.
    [11] M.A. Fischler; R.C. Bolles, "Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography, " Communications of the ACM, vol. 24, 1981, pp. 381-395.
    [12] Uyttendaele, M.; Eden, A.; Skeliski, R., "Eliminating ghosting and exposure artifacts in image mosaics," Computer Vision and Pattern Recognition, 2001. CVPR 2001. Proceedings of the 2001 IEEE Computer Society Conference on , vol.2, no., pp. II-509- II-516 vol.2, 2001
    [13] A. Levin, A. Zomet, S. Peleg, Y. Weiss, "Seamless Image Stitching in the Gradient Domain," IN EIGHTH EUROPEAN CONFERENCE ON COMPUTER VISION (ECCV 2004, vol. 4, 2003, pp. 377-389.
    [14] Junghee Jun; Choongwon Kim, "Robust camera calibration using neural network," TENCON 99. Proceedings of the IEEE Region 10 Conference , vol.1, no., pp.694-697 vol.1, 1999.
    [15] Moravec, H. P., “Towards automatic visual obstacle avoidance,” in Proc. 5th International Joint Conference on Artificial Intelligence, Tokyo, 1977, pp.584.
    [16] Harris, C. and M. Stephens, "A combined corner and edge detector," in Proc. of The Fourth Alvey Vision Conference, Manchester, Aug.31-Sep.2, 1988, pp.147-151.
    [17] W. Long and Y.H. Yang, "Stationary background generation: an alternative to the difference of two images," in Proc. Of Pattern Recognition, Vol. 23, No. 12, pp.1351-1359, 1990.
    [18] A. H. S. Lai and N.H.C. Yung, "A fast and accurate scoreboard algorithm for estimating stationary backgrounds in an image sequences," in Proc. Of IEEE Int’s Symp. On Circuits and Systems, Vol. 4, pp.241-244, 1998.
    [19] S.Y. Chen, S. Y. Ma, and L. G. Chen, "Efficient moving object segmentation algorithm using background registration technique," IEEE Transactions on Circuits and Systems for Video Technology , pp. 577-586,2002.
    [20] D. W. Lim, S.H. Choi, and J.S. Jun, "Automated detection of all kinds of violations at a street intersection using real Time individual vehicle tracking," in Proc. Of Fifth IEEE Southwest Symposium on Image Analysis and Interpretation, pp.126-129, 2002.
    [21] Y. K. Jung and Y.S. Ho, "Traffic parameter extraction using video-based vehicle tracking," in Proc. Of IEEE Int’l Conf. on Intelligent Transportation Systems, pp.764-769, 1999.
    [22] Y. C. Chung, J. M. Wang, and S. W. Chen, " Progressive Background Image Generation. " in Proc. of 15th IPPR Conf. on Computer Vision, Graphics and Image Processing, pp. 858-865, 2002.
    [23] P. R. Beaudet, "Rotational invariant image operators," in Proceedings of the 4th International Joint Conference on Pattern Recognition, pp. 579–583, 1978.
    [24] 邱國恩, "JPEG2000編碼器的VLSI架構,"義守大學電機工程學系碩士學位論文, 2006.
    [25] Ching-Han Chen; Jia-Hong Dai, "Design and High-Level Synthesis of Discrete-Event Controller", National Conference of Automatic Control and Mechtronics System. Taiwan, R.O.C., pp. 75-80. , 2002.
    [26] 鄒文姍, "動態視訊之即時影像階圖系統,"元智大學資訊工程學系碩士學位論文, 2002.
    [27] S. Hsieh, C. Chen, "Adaptive image interpolation using probabilistic neural network," Expert Systems with Applications, vol. 36, 2009, pp. 6025-6029.
    [28] DigiVFX., "Image Stitching." [Online]. Available: http://www.csie.ntu.edu.tw/~cyy/courses/vfx/09spring/lectures/ lec06_stitching-1.ppt
    [29] C.F.Lin and S.C.Sung, "A featureless image registration method with high accuracy," Thesis of the institute of Electrical Engineering and Computer Engineering and Science, Yuan-Ze University. 2000.
    [30] R.Jain, E.Kasturi and B.G.Schunck, Machine Vision, McGraw-Hill. Inc., New York, U.S.A., 1995.
    [31] Li Zhong-xin; Xu Wan-he; Wu Zhi-lin; Zhang Yue, "Video Mosaic with Motion Estimation," Information and Computing Science, 2009. ICIC '09. Second International Conference on , vol.2, no., pp.106-109, 21-22 May 2009.
    [32] Patil, R.; Rybski, P.E.; Kanade, T.; Veloso, M.M., "People detection and tracking in high resolution panoramic video mosaic," Intelligent Robots and Systems, 2004. (IROS 2004). Proceedings. 2004 IEEE/RSJ International Conference on , vol.2, no., pp. 1323- 1328 vol.2, 28 Sept.-2 Oct. 2004.
    [33] 謝東成, "保留邊緣特性之影像放大方法,"國立台灣科技大學電機工程學系碩士學位論文, 2006.
    Advisor
  • Ching-han Chen(陳慶瀚)
  • Files
  • 975202086.pdf
  • approve in 3 years
    Date of Submission 2010-07-26

    [Back to Results | New Search]


    Browse | Search All Available ETDs

    If you have dissertation-related questions, please contact with the NCU library extension service section.
    Our service phone is (03)422-7151 Ext. 57407,E-mail is also welcomed.