A method of segmenting apples at night based on color and position information

作者:Liu, Xiaoyang*; Zhao, Dean; Jia, Weikuan; Ruan, Chengzhi; Tang, Shuping; Shen, Tian
来源:Computers and Electronics in Agriculture, 2016, 122: 118-123.
DOI:10.1016/j.compag.2016.01.023

摘要

This paper proposes a method to segment apples on trees at night for apple-harvesting robots based on color and position of pixels. Images of apples acquired under artificial light with low illumination at night include less color information than daytime images, so it is necessary to take position of pixels into consideration. The new method has two main steps. Firstly, color components of sampled pixels in RGB and HSI color space are used to train a neural network model to segment the apples. However, the segmentation results are incomplete and not able to guide apple-harvesting robots accurately, because partial edge regions of apples are dark in shadows and difficult to be recognized due to uneven illumination. Secondly, the color and position of pixels around segmented regions and pixels on the boundary of segmented regions are taken into consideration to segment the edge regions of apples. The union of two segmentation results is the final result. The complete recognition can increase the accuracy of location by about 6.5%, which verified the validity and feasibility of the method.