research-article
- Authors:
- Pengcheng Zhou Key Lab of Smart Agriculture Systems Integration, Ministry of Education, China Agricultural University, China
Key Lab of Smart Agriculture Systems Integration, Ministry of Education, China Agricultural University, China
Search about this author
- Lihua Zheng Key Lab of Smart Agriculture Systems Integration, Ministry of Education, China Agricultural University, China
Key Lab of Smart Agriculture Systems Integration, Ministry of Education, China Agricultural University, China
Search about this author
- Minjuan Wang Key Lab of Smart Agriculture Systems Integration, Ministry of Education, China Agricultural University, China
Key Lab of Smart Agriculture Systems Integration, Ministry of Education, China Agricultural University, China
Search about this author
- Minzan Li Key Lab of Smart Agriculture Systems Integration, Ministry of Education, China Agricultural University, China
Key Lab of Smart Agriculture Systems Integration, Ministry of Education, China Agricultural University, China
Search about this author
CVDL '24: Proceedings of the International Conference on Computer Vision and Deep LearningJanuary 2024Article No.: 41Pages 1–7https://doi.org/10.1145/3653781.3653825
- 0citation
- 0
- Downloads
Metrics
Total Citations0Total Downloads0Last 12 Months0
Last 6 weeks0
- Get Citation Alerts
New Citation Alert added!
This alert has been successfully added and will be sent to:
You will be notified whenever a record that you have chosen has been cited.
To manage your alert preferences, click on the button below.
Manage my Alerts
New Citation Alert!
Please log in to your account
- Publisher Site
- Get Access
CVDL '24: Proceedings of the International Conference on Computer Vision and Deep Learning
A Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg
Pages 1–7
PreviousChapterNextChapter
ABSTRACT
Abstract: The application of automated apple harvesting technology significantly reduces labor costs and enhances picking efficiency. Currently, apple instance segmentation based on neural networks become popular approach because it offers higher accuracy compared to traditional apple detection models, and it can recognize apples at the pixel level. However, training these deep learning models means greater computational complexity and resource demands, which cannot be provided well in the apple picking field. To address these problems, we propose a lightweight algorithm model, YOLO-AppleSeg, built upon the YOLOv5s-seg model, specifically designed for instance segmentation of apple fruits in actual orchard environments, in which a novel lightweight convolution, EMSConv (Efficient Multi-Scale Convolution), is introduced. First, the image data from real-world scenarios consist of the following three parts: self-collected data, publicly accessible datasets, and images sourced from the Internet, and these data are labeled to construct a dataset for apple fruit instance segmentation modeling. Second, the YOLOv5s-seg model is improved to develop the lightweight YOLO-AppleSeg model for apple fruit instance segmentation. Finally, the model is trained, the ablation experiments are carried out, and model performance evaluation is conducted accordingly. The experimental results indicate that the proposed model achieves an AP50 score of 93.7 and an AP50-95 score of 74.6 for apple fruit instance segmentation, with only 30% of the parameters and 83% of the computational resources compared to the YOLOv5s-seg model, which is of significant importance for the automated harvesting of apple fruits in actual orchard field.
Keywords: Apple Detection; Automated Fruit Harvesting; Instance Segmentation; Convolution; Lightweight Model
References
- Rakun J, Stajnko D, Zazula D. Detecting fruits in natural scenes by using spatial-frequency based texture analysis and multiview geometry[J]. Computers and Electronics in Agriculture, 2011, 76(1): 80-88.Google Scholar
Digital Library
- Song Y, Glasbey C A, Horgan G W, Automatic fruit recognition and counting from multiple images[J]. Biosystems Engineering, 2014, 118: 203-215.Google Scholar
Cross Ref
- Liu G, Mao S, Kim J H. A mature-tomato detection algorithm using machine learning and color analysis[J]. Sensors, 2019, 19(9): 2023.Google Scholar
Cross Ref
- Benavides M, Cantón-Garbín M, Sánchez-Molina J A, Automatic tomato and peduncle location system based on computer vision for use in robotized harvesting[J]. Applied Sciences, 2020, 10(17): 5887.Google Scholar
Cross Ref
- Bai Y, Mao S, Zhou J, Clustered tomato detection and picking point location using machine learning-aided image analysis for automatic robotic harvesting[J]. Precision Agriculture, 2023, 24(2): 727-743.Google Scholar
Cross Ref
- Yan B, Fan P, Lei X, A real-time apple targets detection method for picking robot based on improved YOLOv5[J]. Remote Sensing, 2021, 13(9): 1619.Google Scholar
Cross Ref
- Kounalakis N, Kalykakis E, Pettas M, Development of a Tomato Harvesting Robot: Peduncle Recognition and Approaching[C]//2021 3rd International Congress on Human-Computer Interaction, Optimization and Robotic Applications (HORA). IEEE, 2021: 1-6.Google Scholar
- Rong Q, Hu C, Hu X, Picking point recognition for ripe tomatoes using semantic segmentation and morphological processing[J]. Computers and Electronics in Agriculture, 2023, 210: 107923.Google Scholar
Digital Library
- Yu Y, Zhang K, Yang L, Fruit detection for strawberry harvesting robot in non-structural environment based on Mask-RCNN[J]. Computers and Electronics in Agriculture, 2019, 163: 104846.Google Scholar
Digital Library
- Jia W, Tian Y, Luo R, Detection and segmentation of overlapped fruits based on optimized mask R-CNN application in apple harvesting robot[J]. Computers and Electronics in Agriculture, 2020, 172: 105380.Google Scholar
Cross Ref
- Jia W, Wei J, Zhang Q, Accurate segmentation of green fruit based on optimized mask RCNN application in complex orchard[J]. Frontiers in Plant Science, 2022, 13: 955256.Google Scholar
Cross Ref
- Gené-Mola J, Sanz-Cortiella R, Rosell-Polo JR, Morros J-R, Ruiz-Hidalgo J, Vilaplana V, , Gregorio E. 2020. Fuji-SfM dataset: a collection of annotated images and point clouds for Fuji apple detection and location using structure-from-motion photogrammetry.Google Scholar
- Gené-Mola J, Sanz-Cortiella R, Rosell-Polo JR, Morros J-R, Ruiz-Hidalgo J, Vilaplana V, , Gregorio E. 2020. Fruit detection and 3D location using instance segmentation neural networks and structure-from-motion photogrammetry. Computers and Electronics in Agriculture, 169 (2020), 105165.Google Scholar
- N.R. Pal, On minimum cross-entropy thresholding, Pattern Recognit. 29 (4) (1996) 575–580.Google Scholar
Cross Ref
- Ji, W.; Liu, D.; Meng, Y.; Liao, Q. Exploring the solutions via retinex enhancements for fruit recognition impacts of outdoor sunlight: A case study of navel oranges. Evol. Intell. 2022, 15, 1875–1911.Google Scholar
Cross Ref
- Wang, C. Y., Liao, H. Y. M., Wu, Y. H., Chen, P. Y., Hsieh, J. W., and Yeh, I. H. (2020). "CSPNet: A new backbone that can enhance learning capability of CNN," in: Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA, 390-391.Google Scholar
- Liu S, Qi L, Qin H, Path aggregation network for instance segmentation[C]//Proceedings of the IEEE conference on computer vision and pattern recognition. 2018: 8759-8768.Google Scholar
- Howard A G, Zhu M, Chen B, Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861, 2017.Google Scholar
- Chollet F. Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE conference on computer vision and pattern recognition. 2017: 1251-1258.Google Scholar
- Zhang X, Zhou X, Lin M, Shufflenet: An extremely efficient convolutional neural network for mobile devices[C]//Proceedings of the IEEE conference on computer vision and pattern recognition. 2018: 6848-6856.Google Scholar
- Han K, Wang Y, Tian Q, Ghostnet: More features from cheap operations[C]//Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 2020: 1580-1589.Google Scholar
- Bolya D, Zhou C, Xiao F, Yolact: Real-time instance segmentation[C]//Proceedings of the IEEE/CVF international conference on computer vision. 2019: 9157-9166.Google Scholar
Cited By
View all
Recommendations
- Apple HomePod: Master your HomePod, User Guide and Manual
Read More
- Apple Watch: The Complete Apple Watch User Guide And Manual - Master Your Apple Watch In 24 Hours Or Less!
Read More
- Apple Watch Guide: The unofficial Apple Watch user guide for dummies (With special focus on tips and tricks for optimizing the Apple Watch with your iPhone and Apple TV)
Read More
See Alsobluestack bios setting
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in
Full Access
Get this Publication
- Information
- Contributors
Published in
CVDL '24: Proceedings of the International Conference on Computer Vision and Deep Learning
January 2024
506 pages
ISBN:9798400718199
DOI:10.1145/3653804
Copyright © 2024 ACM
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [emailprotected].
Sponsors
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
- Published: 1 June 2024
Permissions
Request permissions about this article.
Qualifiers
- research-article
- Research
- Refereed limited
Conference
Funding Sources
Other Metrics
View Article Metrics
- Bibliometrics
- Citations0
Article Metrics
- View Citations
Total Citations
Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Other Metrics
View Author Metrics
Cited By
This publication has not been cited yet
PDF Format
View or Download as a PDF file.
eReader
View online with eReader.
eReader
Digital Edition
View this article in digital edition.
View Digital Edition
HTML Format
View this article in HTML Format .
View HTML Format
- Figures
- Other
Close Figure Viewer
Browse AllReturn
Caption
View Table of Contents
Export Citations
Your Search Results Download Request
We are preparing your search results for download ...
We will inform you here when the file is ready.
Download now!
Your Search Results Download Request
Your file of search results citations is now ready.
Download now!
Your Search Results Download Request
Your search export query has expired. Please try again.