基于单目显微视觉的微球姿态测量方法

李迎; 张大朋; 刘希龙; 徐德

doi:10.16383/j.aas.2018.c180009

基于单目显微视觉的微球姿态测量方法

doi: 10.16383/j.aas.2018.c180009

李迎^1,2,,
张大朋^1,2,,
刘希龙^1,2,,
徐德^1,2, ,

1.
中国科学院自动化研究所精密感知与控制研究中心北京 100190
2.
中国科学院大学北京 101408

基金项目:

国家自然科学基金 61673382

科学挑战专题 TZ2018006-0204-02

国家自然科学基金 61733004

国家自然科学基金 61673383

详细信息

作者简介:
李迎  中国科学院自动化研究所硕士研究生.2016年获得华北电力大学(保定)学士学位.主要研究方向为视觉测量, 视觉控制, 微装配与机器学习.E-mail:liying2016@ia.ac.cn

张大朋  中国科学院自动化研究所副研究员.2003年、2006年获得河北工业大学学士和硕士学位.2011年获得北京航空航天大学博士学位.主要研究方向为视觉控制, 微装配, 医疗机器人.E-mail:dapeng.zhang@ia.ac.cn

刘希龙  中国科学院自动化研究所副研究员.2009年获得北京交通大学学士学位.2014年获得中国科学院自动化研究所博士学位.主要研究方向为图像处理, 视觉测量, 服务机器人.E-mail:xilong.liu@ia.ac.cn

通讯作者:
徐德中国科学院自动化研究所研究员.1985年、1990年获得山东工业大学学士、硕士学位.2001年获得浙江大学博士学位.主要研究方向为机器人视觉测量, 视觉控制, 智能控制, 视觉定位, 显微视觉, 微装配.本文通信作者. E-mail:de.xu@ia.ac.cn

计量
- 文章访问数: 1836
- HTML全文浏览量: 516
- PDF下载量: 415
- 被引次数: 0
出版历程
- 收稿日期: 2018-01-08
- 录用日期: 2018-04-04
- 刊出日期: 2019-07-20

A Pose Measurement Method for Micro Sphere Based on Monocular Microscopic Vision

LI Ying^{1,2
,},
ZHANG Da-Peng^{1,2
,},
LIU Xi-Long^{1,2
,},
XU De^{1,2
, ,}

1.
Research Center of Precision Sensing and Control, Institute of Automation, Chinese Academy of Sciences, Beijing 100190
2.
University of Chinese Academy of Sciences, Beijing 101408

Funds:

National Natural Science Foundation of China 61673382

Science Challenge Project TZ2018006-0204-02

National Natural Science Foundation of China 61733004

National Natural Science Foundation of China 61673383

More Information

Author Bio:
Master student at the Institute of Automation, Chinese Academy of Sciences (IACAS). He received his bachelor degree from North China Electric Power University (Baoding) in 2016. His research interest covers visual measurement, visual control, micro-assembly, and machine learning

Associate professor at the Institute of Automation, Chinese Academy of Sciences (IACAS). He received his bachelor and master degrees from the Hebei University of Technology in 2003 and 2006, respectively, and Ph. D. degree from the Beihang University in 2011. His reaearch interest covers visual control, micro-assembly, and medical robot

Associate professor at the Institute of Automation, Chinese Academy of Sciences (IACAS). He received his bachelor degree from Beijing Jiaotong University in 2009 and his Ph. D. degree from Institute of Automation, Chinese Academy of Sciences (IACAS) in 2014. His reaearch interest covers image processing, visual measurement, and service robot

Corresponding author: XU De Professor at the Institute of Automation, Chinese Academy of Sciences. He received his bachelor degree and master degree from Shandong University of Technology in 1985 and 1990, respectively, and received his Ph. D. degree from Zhejiang University in 2001. His research interest covers robotics and automation such as visual measurement, visual control, intelligent control, visual positioning, microscopic vision, and microassembly. Corresponding author of this paper

摘要

摘要: 微零件的姿态测量对微装配具有重要的作用.但对于微球零件，其姿态的精确测量存在困难，影响了装配精度.针对带有微孔的微球，本文提出了一种基于单目显微视觉的微球姿态高精度测量方法.设计了一种由粗到精的微孔检测算法，实现了高精度的微孔定位.通过对相机光轴方向的标定，在相机运动后对微球图像坐标进行补偿，提高了在相机坐标系下的微球定位精度.通过对微球和微孔的精确定位，计算出微球球心与微孔圆心的空间相对位置，实现了相机坐标系下高精度的微球姿态测量.同时，根据标定出的相机坐标系与调整平台坐标系之间的旋转关系，将微球姿态转换到调整平台坐标系.实验结果表明，最大姿态测量误差0.3度，验证了本文方法的有效性.
- 微孔检测 /
- 微球定位 /
- 姿态测量 /
- 视觉测量 /
- 单目显微视觉
Abstract: Pose measurement for micro-components is very important to micro assembly. But it is quite difficult to measure the pose of a micro sphere with high precision, which impacts the assembly accuracy. An accurate pose measurement method for sphere with micro hole is proposed. A coarse-to-fine detection method is designed for the micro-hole on the micro-sphere. It realizes the high precision location of the micro-hole. The direction of the microscopic camera's optical axis is calibrated. It is used to compensate the micro-sphere's image coordinates after the microscopic camera moves in order to improve the location accuracy of the micro-sphere in the camera's frame. The relative position between the center of sphere and the center of hole can be easily derived from the accurately located micro-sphere and micro-hole. Then the pose of micro-sphere can be gotten. Meanwhile, the pose of micro-sphere can be transformed from the camera's frame into the frame of adjusting platform according to the calibrated rotation relationship between the two frames. The maximum error in pose measurements is 0.3 degree. Experimental results verify the effectiveness of the proposed method.
- Micro-hole detection /
- micro-sphere location /
- pose measurement /
- vision measurement /
- monocular microscopic vision
注释:

1) 本文责任编委董峰

HTML全文

图 1 微球零件示意图

Fig. 1 Micro-sphere component

下载: 全尺寸图片幻灯片

图 2 实验系统示意图

Fig. 2 Experiment system

下载: 全尺寸图片幻灯片

图 3 实验系统坐标系

Fig. 3 Coordinates of experiment system

下载: 全尺寸图片幻灯片

图 4 相机聚焦示意图

Fig. 4 Camera focusing

下载: 全尺寸图片幻灯片

图 5 微球上的微孔

Fig. 5 The micro-hole on the micro-sphere

下载: 全尺寸图片幻灯片

图 6 微孔、微球定位流程图

Fig. 6 Location flow chart of micro-hole and micro-sphere

下载: 全尺寸图片幻灯片

图 7 微孔边缘的精确提取示意图

Fig. 7 Precision extraction of micro-hole edge

下载: 全尺寸图片幻灯片

图 8 实验系统

Fig. 8 The real experiment system

下载: 全尺寸图片幻灯片

图 9 微孔边缘点提取结果

Fig. 9 The edge extraction result of micro-hole

下载: 全尺寸图片幻灯片

图 10 微孔精确定位结果

Fig. 10 The precision location result of micro-hole

下载: 全尺寸图片幻灯片

图 11 微球精确定位结果

Fig. 11 The precision location result of micro-sphere

下载: 全尺寸图片幻灯片

图 12 在坐标系{C}中的微球姿态向量

Fig. 12 The pose vector of micro-sphere in {C}

下载: 全尺寸图片幻灯片

图 13 绕Y_W轴旋转后的姿态向量

Fig. 13 The pose vector after rotating along with Y_W axis

下载: 全尺寸图片幻灯片

图 14 绕X_W轴旋转后的姿态向量

Fig. 14 The pose vector after rotating along with X_W axis

下载: 全尺寸图片幻灯片

图 15 同时绕X_W和Y_W轴旋转后的姿态向量

Fig. 15 The pose vector after rotating along with X_W and Y_W axis, simultaneously

下载: 全尺寸图片幻灯片

表 1 在坐标系{C}中的微球姿态向量

Table 1 The pose vector of micro-sphere in {C}

编号	1	2	3	4	5
∆x_c	0.0350	0.0362	0.0366	0.0370	0.0375
∆y_c	0.0186	0.0254	0.0320	0.0378	0.0439
∆z_c	-0.9992	-0.9990	-0.9988	-0.9985	-0.9983

下载: 导出CSV

表 2 绕Y_W轴旋转的实验结果

Table 2 The results of rotating along with Y_W axis

	绕X_W, Y_W旋转角(度)
编号	真实值	测量值
1	0, -3	-0.04, -3.0
2	0, -2	-0.02, -2.0
3	0, -1	-0.04, -1.0
4	0, 1	0.06, 1.1
5	0, 2	-0.00, 2.2
6	0, 3	0.12, 3.1

下载: 导出CSV

表 3 绕X_W轴旋转的实验结果

Table 3 The results of rotating along with X_W axis

	绕X_W, Y_W旋转角(度)
编号	真实值	测量值
1	-5, 0	-4.9, -0.03
2	-4, 0	-3.9, 0.02
3	-3, 0	-2.9, -0.01
4	-2, 0	-2.0, -0.02
5	-1, 0	-1.0, -0.05
6	1, 0	1.0, -0.02
7	2, 0	2.0, -0.04
8	3, 0	3.0, 0.01
9	4, 0	3.9, 0.01
10	5, 0	4.9, -0.03

下载: 导出CSV

表 4 同时绕X_W、Y_W轴旋转的实验结果

Table 4 The results of rotating along with X_W, Y_W axis, simultaneously

	绕X_W, Y_W旋转角(度)
编号	真实值	测量值
1	-5, -3	-4.8, -3.1
2	-3, -2	-3.0, -2.1
3	-1, -1	-1.0, -1.1
4	1, 1	1.0, 0.9
5	3, 2	3.0, 1.8
6	5, 3	4.8, 2.8

下载: 导出CSV

参考文献(13)

[1]	Liu S, Xu D, Zhang D, Zhang Z. High precision automatic assembly based on microscopic vision and force information. IEEE Transactions on Automation Science and Engineering, 2016, 13(1):382-393 doi: 10.1109/TASE.2014.2332543
[2]	Liu S, Xu D, Liu F, Zhang D, Zhang Z. Relative pose estimation for alignment of long cylindrical components based on microscopic vision. IEEE/ASME Transactions on Mechatronics, 2016, 21(3), 1388-1398 doi: 10.1109/TMECH.2015.2506906
[3]	Jin P, Matikainen P, Srinivasa S S. Sensor fusion for fiducial tags: highly robust pose estimation from single frame RGBD. In: Proceedings of the 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems. Vancouver, Canada: IEEE, 2017. 5770-5776
[4]	Zheng W, Yan B, Wang Z. Multi-sensor fusion based pose estimation for unmanned aerial vehicles on ships. In: Proceedings of the 2016 IEEE International Conference on Information and Automation. Ningbo, China: IEEE, 2016. 648-653
[5]	Chen Y, Fu M, Yang Y, Song W. A method of head pose estimation based on active shape model and stereo vision. In: Proceedings of the 33rd Chinese Control Conference. Nanjing, China: IEEE, 2014. 8277-8282
[6]	Su J, Huang X, Wang M. Pose detection of partly covered target in micro-vision system. In: Proceedings of the 10th World Congress on Intelligent Control and Automation. Beijing, China: IEEE, 2012. 4721-4725
[7]	Zhang P, Xu D, Wu B. Pose estimation for plane based on monocular microscope vision system. In: Proceedings of the 32nd Chinese Control Conference. Xi'an, China: IEEE, 2013. 5687-5692
[8]	Jiang C, Mills J K. Planar cell orientation control system using a rotating electric field. IEEE/ASME Transactions on Mechatronics, 2015, 20(5):2350-2358 doi: 10.1109/TMECH.2014.2377116
[9]	Liu S, Li Y, Xing D, Xu D, Su H. An efficient insertion control method for precision assembly of cylindrical components. IEEE Transactions on Industrial Electronics, 2017, 64(12):9355-9365 doi: 10.1109/TIE.2017.2711551
[10]	Park H, Park J, Lee D H, Park J H, Baeg M H, Bae J H. Compliance-based robotic peg-in-hole assembly strategy without force feedback. IEEE Transactions on Industrial Electronics, 2017, 64(8):6299-6309 doi: 10.1109/TIE.2017.2682002
[11]	Das A N, Popa D O. Precision evaluation of modular multiscale robots for peg-in-hole microassembly tasks. In: Proceedings of the 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems. San Francisco, USA: IEEE, 2011. 1699-1704
[12]	史亚莉, 张正涛, 徐德.跨尺度微管微球三维半自动装配点胶系统.光学精密工程, 2015, 23(11):3121-3128 http://d.old.wanfangdata.com.cn/Periodical/gxjmgc201511016 Shi Ya-li, Zhang Zheng-tao, Xu De. 3D semi-automatic assembly and dispensing system for trans-scale parts of micro-tube and micro-sphere. Optics and Precision Engineering, 2015, 23(11):3121-3128 http://d.old.wanfangdata.com.cn/Periodical/gxjmgc201511016
[13]	Li F, Xu D, Zhang Z, Shi Y, Shen F. Pose measuring and aligning of a micro glass tube and a hole on the micro sphere. International Journal of Precision Engineering and Manufacturing, 2014, 15(12):2483-2491 doi: 10.1007/s12541-014-0618-0