Hybrid Consensus and Recovery Block-Based Detection of Ripe Coffee Cherry Bunches Using RGB-D Sensor

Abstract

Detection of fruits for automatic harvesting using vision sensors has gained attention in recent times. In this work, we consider the problem of the detection of ripe cherry bunches for the selective harvesting of coffee cherries. The coffee cherries are small in size and appear in a clustered arrangement which makes it difficult to detect them. Also, the previous studies indicate that the accuracy of the available techniques for fruit detection is not sufficient for use in real-time harvesting operations. Hence, we propose a novel Hybrid Consensus and Recovery Block (HCRB) based technique for the reliable detection of the ripe coffee cherry bunches for the coffee harvester robot using RGB-D sensor. Our studies via simulation as well as on hardware set-up indicate a significant increase in true positive and decrease in false positive detections which makes it suitable for use in real-time harvesters. The proposed system provides accuracy, precision, recall, and F1- score of 93%, 97%, 92%, and 93% respectively when tested on the NVIDIA Jetson Nano Development board.