A Survey on Extrinsic Self-calibration Algorithms for Cameras without Overlapping Field of Views
-
摘要: 视频传感器外部参数自校准,即确定视频传感器的坐标和转角,是实现视频传感器网络应用的重要前提.不同于有重叠视域的视频传感器网络,无重叠视域的视频传感器网络中的视频传感器之间没有可以共享的、可以辅助求解它们的外部参数的信息,所以实现无重叠视域视频传感器外部参数自校准更加富有挑战性.本文回顾了国内外学者在无重叠视域视频传感器外部参数自校准方面的研究工作,着重对目前已有的算法进行了详细的分类和介绍,最后从多方面综合评述了各种算法的性能.Abstract: Extrinsic self-calibration of cameras, i.e., to automatically determine the extrinsic parameters of the cameras (position and orientation), is regarded as an important preparatory requirement. However, if the cameras do not share overlapping field of views (FoVs), they lack the common information, which is normally obtained from the shared FoVs and used to design the self-calibration algorithms. Hence, it is more difficult and challenging to design the extrinsic self-calibration algorithm in non-overlapping camera networks. In this paper, the existing extrinsic camera self-calibration algorithms for non-overlapping camera networks are reviewed, classified and summarized in detail.
-
[1] Kamijo S,Matsushita Y,Ikeuchi K,Sakauchi M. Traffic monitoring and accident detection at intersections. IEEE Transactions on Intelligent Transportation Systems,2000,1(2):108-118[2] Cucchiara R,Piccardi M,Mello P. Image analysis and rule-based reasoning for a traffic monitoring system. IEEE Transactions on Intelligent Transportation Systems,2000,1(2):119-130[3] Masoud O,Papanikolopoulos N P,Kwon E. The use of computer vision in monitoring weaving sections. IEEE Transactions on Intelligent Transportation Systems,2001,2(1):18-25[4] Valera M,Velastin S A. Intelligent distributed surveillance systems:a review. IEE Proceedings --- Vision,Image and Signal Processing,2005,152(2):192-204[5] He T,Krishnamurthy S,Stankovic J A,Abdelzaher T,Luo L,Stolern R,Yan T,Gu L,Zhou G. VigilNet:an integrated sensor network system for energy-efficient surveillance. ACM Transactions on Sensor Networks,2006,2(1):1-38[6] Chen W,Aghajan H. Head pose and trajectory recovery in uncalibrated camera networks-region of interest tracking in smart home applications. In:Proceedings of the 2nd ACM/IEEE International Conference on Distributed Smart Cameras. Stanford,USA:IEEE,2008. 1-7[7] Ikebe H,Ogawa K,Hatayama Y. Networked camera system using new home network architecture with flexible scalability. In:Proceedings of the International Conference on Consumer Electronics. Washington D. C.,USA:IEEE,2005. 151-152[8] Tabar A M,Keshavarz A,Aghajan H. Smart home care network using sensor fusion and distributed vision-based reasoning. In:Proceedings of the 4th ACM International Workshop on Video Surveillance and Sensor Networks. Santa Barbara,USA:ACM,2006. 145-154[9] Qureshi F,Terzopoulos D. Smart camera networks in virtual reality. In:Proceedings of the 1st ACM/IEEE International Conference on Distributed Smart Cameras. Vienna,Austria:IEEE,2007. 87-94[10] McCurdy N J,Griswold W. A system architecture for ubiquitous video. In:Proceedings of the 3rd Annual International Conference on Mobile Systems,Applications,and Services. Seattle,USA:ACM,2005. 1-14[11] Qureshi F,Terzopoulos D. Surveillance in virtual reality:system design and multi-camera control. In:Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Minneapolis,USA:IEEE,2007. 1-8[12] Stoakley R,Conway M J,Pausch R. Virtual reality on a WIM:interactive worlds in miniature. In:Proceedings of the SIGCHI Conference on Human Factors in Computing System. Denver. USA:ACM,1995. 265-272[13] Alikhani S,St-Hilaire M,Kunz T. iCCA-MAP:a new mobile node localization algorithm. In:Proceedings of the IEEE International Conference on Wireless and Mobile Computing,Networking and Communications. Marrakech,Morocco:IEEE,2009. 382-387[14] Gasparri A,Pascucci F. An interlaced extended information filter for self-localization in sensor networks. IEEE Transactions on Mobile Computing,2010,9(10):1491-1504[15] Noureddine H,Gresset N,Castelain D,Pyndiah R. A new variant of nonparametric belief propagation for self-localization. In:Proceedings of the 17th IEEE International Conference on Telecommunications. Doha,Qatar:IEEE,2010. 822-827[16] Nicolescu D,Nath B. Ad hoc positioning system (APS) using AOA. In:Proceedings of the 22nd Annual Joint Conference of the IEEE Computer Communications. San Francisco,USA:IEEE,2003. 1734-1743[17] Doherty L. Algorithms for Position and Data Recovery in Wireless Sensor Networks [Master dissertation],University of California,USA,2000[18] Kinh T,Dalley G,Grimson W E L. Inference of non-overlapping camera network topology by measuring statistical dependence. In:Proceedings of the 10th IEEE International Conference on Computer Vision. Beijing,China:IEEE,2005. 1842-1849[19] Beymer D,McLauchlan P,Coifman B,Malik J. A real-time computer vision system for measuring traffic parameters. In:Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. San Juan,Puerto Rico:IEEE,1997. 495-501[20] Rong Rui-Xia,Ou Long,Zhang Li-Na,He Chun-Mei. The demarcating method of the general digital camera based on the vanishing point theory. Chinese Journal of Engineering Geophysics,2007,4(2):152-156(荣瑞霞,欧龙,张丽娜,贺春梅. 基于灭点理论的普通数码相机标定方法. 工程地球物理学报,2007,4(2):152-156)[21] Tsai R. A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. IEEE Journal of Robotics and Automation,1987,3(4):323-344[22] Hemayed E E. A survey of camera self-calibration. In:Proceedings of the IEEE Conference on Advanced Video and Signal Base Surveillance. Los Alamitos,USA:IEEE,2003. 351-357[23] Qiu Mao-Lin,Ma Song-De,Li Yi. Overview of camera calibration for computer vision. Acta Automatica Sinica,2000,26(1):43-55(邱茂林,马颂德,李毅. 计算机视觉中摄像机定标综述. 自动化学报,2000,26(1):43-55)[24] Li Peng,Wang Jun-Ning. Overview of camera calibration methods. Shanxi Electronic Technology,2007,(4):77-79(李鹏,王军宁. 摄像机标定方法综述. 山西电子技术,2007,(4):77-79)[25] Wu Wen-Qi,Sun Zeng-Qi. Overview of camera calibration methods for machine vision. Application Research of Computers,2004,21(2):4-6(吴文琪,孙增圻. 机器视觉中的摄像机定标方法综述. 计算机应用研究,2004,21(2):4-6)[26] Meng Xiao-Qiao,Hu Zhan-Yi. Recent progress in camera self-calibration. Acta Automatica Sinica,2003,29(1):110-124(孟晓桥,胡占义. 摄像机自标定方法的研究与进展. 自动化学报,2003,29(1):110-124)[27] Liu Zhen-Zhong,Fu Li. Research on camera calibration method. Journal of Shenyang Institute of Aeronautical Engineering,2010,27(1):43-47(刘振中,傅莉. 摄像机标定研究. 沈阳航空工业学院学报,2010,27(1):43-47)[28] Zheng Feng-Jie,Yu Tao,Yuan Guo-Ti,Lan Jin-Jing. Overview of geometric camera calibration. Taiyuan Science and Technology,2010,(2):72-73(郑逢杰,余涛,袁国体,兰进京. 相机几何标定方法综述. 太原科技,2010,(2):72-73)[29] Bourgeous W,Ma L,Chen P,Song Z,Chen Y. Simple and efficient extrinsic camera calibration based on a rational model. In:Proceedings of the IEEE International Conference on Mechatronics and Automation. Luoyang,China:IEEE,2006. 177-182[30] Bose B,Grimson E. Ground plane rectification by tracking moving objects. In:Proceedings of the Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance. Nice,France:IEEE,2003. 9-16[31] Liu J,O'Rourke D,Wark T,Lakemond R,Sridharan S. Camera calibration in wireless multimedia sensor networks. In:Proceedings of the 5th International Conference on Intelligent Sensors,Sensor Networks and Information Processing. Melbourne,Australia:IEEE,2009. 301-306[32] Rasheed Z,Cao X,Shafique K,Liu H,Yu L,Lee M,Ramnath K,Choe T,Javed O,Haering N. Automated visual analysis in large scale sensor networks. In:Proceedings of the 2nd ACM/IEEE International Conference on Distributed Smart Cameras. Stanford,USA:IEEE,2008. 1-10[33] Cao X,Wu L,Rasshed Z,Liu H,Choe T,Guo F,Haering N. Automatic geo-registration for port surveillance. International Journal of Pattern Recognition and Artificial Intelligence,2010,24(4):531-555[34] Mantzel W E,Hyeokho C,Baraniuk R G. Distributed camera network localization. In:Proceedings of the Record of the 38th Asilomar Conference on Signals,Systems and Computers. Pacific Grove,USA:IEEE,2004. 1381-1386[35] Mehta V,Sheng W. Distributed calibration of a camera sensor network. In:Proceedings of the IEEE International Conference on Robotics and Biomimetics. Bangkok,Thailand:IEEE,2008. 1974-1979[36] Taylor C,Rahimi A,Bachranch J,Shrobe H,Grue A. Simultaneous localization,calibration and tracking in an ad hoc sensor network. In:Proceedings of the 5th International Conference on Information Processing in Sensor Networks. Nashville,USA:IEEE,2006. 27-33[37] Funiak S,Guestrin C,Paskin M,Sukthankar R. Distributed localization of networked cameras. In:Proceedings of the 5th International Conference on Information Processing in Sensor Networks. Nashville,USA:IEEE,2006. 34-42[38] Meingast M,Songhwai O,Sastry S. Automatic camera network localization using object image tracks. In:Proceedings of the 11th IEEE International Conference on Computer Vision. Rio de Janeiro,Brazil:IEEE,2007. 1-8[39] Liu X,Kulkarni P,Shenoy P,Ganesan D. Snapshot:a self-calibration protocol for camera sensor Networks. In:Proceedings of the 3rd International Conference on Broadband Communications,Networks,and Systems. San Jose,USA:IEEE,2006. 1-10[40] Pagel F. Calibration of non-overlapping cameras in vehicles. In:Proceedings of the IEEE Intelligent Vehicles Symposium. San Diego,USA:IEEE,2010. 1178-1183[41] Kumar R K,Ilie A,Frahm J M,Pollefeys M. Simple calibration of non-overlapping cameras with a mirror. In:Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Anchorage,USA:IEEE,2008. 1-7[42] Lamprecht B,Rass S,Fuchs S,Kydamakya K. Extrinsic camera calibration for an on-board two-camera system without overlapping field of view. In:Proceedings of the IEEE Intelligent Transportation System Conference. Seattle,USA:IEEE,2007. 265-270[43] Anjum N,Cavallaro A. Localization of distributed wireless cameras. In:Proceedings of the 3rd ACM/IEEE International Conference on Distributed Smart Cameras. Como,Italy:IEEE,2009. 1-6[44] Wang Fu-Bao,Shi Long,Ren Feng-Yuan. Self-localization systems and algorithms for wireless sensor networks. Journal of Software,2003,16(5):857-868(王福豹,史龙,任丰原. 无线传感器网络中自身定位系统和算法. 软件学报,2003,16(5):857-868)[45] Rahimi A,Dunagan B,Darrell T. Simultaneous calibration and tracking with a network of non-overlapping sensors. In:Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Washington D. C.,USA:IEEE,2004. 187-194[46] Makris D,Ellis T,Black J. Bridging the gaps between cameras. In:Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Washington D. C.,USA:IEEE,2004. 205-210[47] Fisher R B. Self-organization of randomly placed sensors. In:Proceedings of the 7th European Conference on Computer Vision. Copenhagen,Denmark:Springer,2002. 146-160[48] Pasula H,Russell S J,Ostland M,Ritov Y. Tracking many objects with many sensors. In:Proceedings of the 16th International Joint Conference on Artificial Intelligence. Stockholm,Sweden:Morgan Kaufmann,1999. 1160-1171[49] Kettnaker V,Zabih R. Counting people from multiple cameras. In:Proceedings of the IEEE International Conference on Multimedia Computing and Systems. Florence,Italy:IEEE,1999. 267-271[50] Rudoy M B,Rohrs C E. Enhanced simultaneous camera calibration and path estimation. In:Proceedings of the 40th Asilomar Conference on Signals,Systems and Computers. Pacific Grove,USA:IEEE,2006. 513-520[51] Wang Q,Liu Y. A tractable mechanism for external calibration in non-overlapping camera network. In:Proceedings of the 6th International ICST Conference on Communication and Networking in China. Harbin,China:ICST,2011[52] Wang Q,Liu Y,Shen Y. An accurate extrinsic camera self-calibration method in non-overlapping camera sensor networks. In:Proceedings of the IEEE Instrumentation and Measurement Technology Conference. Binjiang,China:IEEE,2011. 1-6[53] Anjum N,Cavallaro A. Automated localization of a camera network. IEEE Intelligent Systems,2010,(99):1-7[54] Anjum N,Taj M,Cavallaro A. Relative position estimation of non-overlapping cameras. In:Proceedings of the IEEE International Conference on Acoustics,Speech and Signal Processing. Honolulu,USA:IEEE,2007. 281-284[55] Caprile B,Torre V. Using vanishing points for camera calibration. International Journal of Computer Vision,1990,4(2):127-140[56] Wu L,Cao X,Foroosh H. Camera calibration and geo-location estimation from two shadow trajectories. Computer Vision and Image Understanding,2010,114(8):915-927[57] Lv F,Zhao T,Nevatia R. Camera calibration from video of a walking human. IEEE Transactions on Pattern Analysis and Machine Intelligence,2006,28(9):1513-1518[58] Pflugfelder R,Bischof H. People tracking across two distant self-calibrated cameras. In:Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance. London,UK:IEEE,2007. 393-398[59] Pflugfelder R,Bischof H. Localization and trajectory reconstruction in surveillance cameras with nonoverlapping views. IEEE Transactions on Pattern Analysis and Machine Intelligence,2010,32(4):709-721[60] Kosecka J,Zhang W. Video compass. In:Proceedings of the 7th European Conference on Computer Vision. Copenhagen,Denmark:Springer,2002. 476-490[61] Liebowitz D. Camera Calibration and Reconstruction of Geometry from Images [Ph.D. dissertation],University of Oxford,USA,2001[62] Liebowitz D,Zisserman A. Combing scene and auto-calibration constraints. In:Proceedings of the 7th IEEE International Conference on Computer Vision. Kerkyra,Greece:IEEE,1999. 293-300[63] Pflugfelder R,Bischof H. Online auto-calibration in man-made worlds. In:Proceedings of the Digital Image Computing:Techniques and Applications. Cairns,Australia:IEEE,2005. 519-526[64] Schindler G,Dellaert F. Atlanta world:an expectation maximization framework for simultaneous low-level edge grouping and camera calibration in complex man-made environments. In:Proceedings of the IEEE International Computer Society Conference on Computer Vision and Pattern Recognition. Washington D. C.,USA:IEEE,2004. 203-209[65] Li H,Hartley R. The 3D-3D registration problem revisited. In:Proceedings of the 11th IEEE International Conference on Computer Vision. Rio de Janeiro,Brazil:IEEE,2007. 1-8[66] Hartley R,Kahl F. Global optimization through searching rotation space and optimal estimation of the essential matrix. In:Proceedings of the 11th IEEE International Conference on Computer Vision. Rio de Janeiro,Brazil:IEEE,2007. 1-8[67] Junejo I,Cao X,Foroosh H. Geometry of a non-overlapping multi-camera network. In:Proceedings of the IEEE International Conference on Advanced Video and Signal Based Surveillance. Sydney,Australia:IEEE,2006. 43-48[68] Junejo I,Cao X,Foroosh H. Autoconfiguration of a dynamic nonoverlapping camera network. IEEE Transactions on System,Man,and Cybernetics,Part B:Cybernetics,2007,37(4):803-816[69] Lv F,Zhao T,Nevatia R. Self-calibration of a camera from video of a walking human. In:Proceedings of the 16th International Conference on Pattern Recognition. Quebec,Canada:IEEE,2002. 562-567[70] Hartley R,Zisserman A. Multiple View Geometry in Computer Vision (Second Edition). Cambridge:Cambridge University Press,2003[71] Zhang Z. Flexible camera calibration by viewing a plane from unknown orientations. In:Proceedings of the 7th IEEE International Conference on Computer Vision. Kerkyra,Greece:IEEE,1999. 666-673
点击查看大图
计量
- 文章访问数: 2374
- HTML全文浏览量: 48
- PDF下载量: 976
- 被引次数: 0