A Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (2024)

A Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (2)

Advanced Search

cvdl

research-article

  • Authors:
  • Pengcheng Zhou Key Lab of Smart Agriculture Systems Integration, Ministry of Education, China Agricultural University, China

    Key Lab of Smart Agriculture Systems Integration, Ministry of Education, China Agricultural University, China

    A Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (3)0009-0001-4532-5680

    Search about this author

    ,
  • Lihua Zheng Key Lab of Smart Agriculture Systems Integration, Ministry of Education, China Agricultural University, China

    Key Lab of Smart Agriculture Systems Integration, Ministry of Education, China Agricultural University, China

    A Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (4)0000-0002-0089-9437

    Search about this author

    ,
  • Minjuan Wang Key Lab of Smart Agriculture Systems Integration, Ministry of Education, China Agricultural University, China

    Key Lab of Smart Agriculture Systems Integration, Ministry of Education, China Agricultural University, China

    A Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (5)0000-0002-7520-1726

    Search about this author

    ,
  • Minzan Li Key Lab of Smart Agriculture Systems Integration, Ministry of Education, China Agricultural University, China

    Key Lab of Smart Agriculture Systems Integration, Ministry of Education, China Agricultural University, China

    A Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (6)0000-0002-4251-0020

    Search about this author

CVDL '24: Proceedings of the International Conference on Computer Vision and Deep LearningJanuary 2024Article No.: 41Pages 1–7https://doi.org/10.1145/3653781.3653825

Published:01 June 2024Publication HistoryA Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (7)

  • 0citation
  • 0
  • Downloads

Metrics

Total Citations0Total Downloads0

Last 12 Months0

Last 6 weeks0

  • Get Citation Alerts

    New Citation Alert added!

    This alert has been successfully added and will be sent to:

    You will be notified whenever a record that you have chosen has been cited.

    To manage your alert preferences, click on the button below.

    Manage my Alerts

    New Citation Alert!

    Please log in to your account

  • Publisher Site
  • Get Access

CVDL '24: Proceedings of the International Conference on Computer Vision and Deep Learning

A Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg

Pages 1–7

PreviousChapterNextChapter

A Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (8)

ABSTRACT

Abstract: The application of automated apple harvesting technology significantly reduces labor costs and enhances picking efficiency. Currently, apple instance segmentation based on neural networks become popular approach because it offers higher accuracy compared to traditional apple detection models, and it can recognize apples at the pixel level. However, training these deep learning models means greater computational complexity and resource demands, which cannot be provided well in the apple picking field. To address these problems, we propose a lightweight algorithm model, YOLO-AppleSeg, built upon the YOLOv5s-seg model, specifically designed for instance segmentation of apple fruits in actual orchard environments, in which a novel lightweight convolution, EMSConv (Efficient Multi-Scale Convolution), is introduced. First, the image data from real-world scenarios consist of the following three parts: self-collected data, publicly accessible datasets, and images sourced from the Internet, and these data are labeled to construct a dataset for apple fruit instance segmentation modeling. Second, the YOLOv5s-seg model is improved to develop the lightweight YOLO-AppleSeg model for apple fruit instance segmentation. Finally, the model is trained, the ablation experiments are carried out, and model performance evaluation is conducted accordingly. The experimental results indicate that the proposed model achieves an AP50 score of 93.7 and an AP50-95 score of 74.6 for apple fruit instance segmentation, with only 30% of the parameters and 83% of the computational resources compared to the YOLOv5s-seg model, which is of significant importance for the automated harvesting of apple fruits in actual orchard field.

Keywords: Apple Detection; Automated Fruit Harvesting; Instance Segmentation; Convolution; Lightweight Model

References

  1. Rakun J, Stajnko D, Zazula D. Detecting fruits in natural scenes by using spatial-frequency based texture analysis and multiview geometry[J]. Computers and Electronics in Agriculture, 2011, 76(1): 80-88.Google ScholarA Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (9)Digital Library
  2. Song Y, Glasbey C A, Horgan G W, Automatic fruit recognition and counting from multiple images[J]. Biosystems Engineering, 2014, 118: 203-215.Google ScholarA Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (11)Cross Ref
  3. Liu G, Mao S, Kim J H. A mature-tomato detection algorithm using machine learning and color analysis[J]. Sensors, 2019, 19(9): 2023.Google ScholarA Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (13)Cross Ref
  4. Benavides M, Cantón-Garbín M, Sánchez-Molina J A, Automatic tomato and peduncle location system based on computer vision for use in robotized harvesting[J]. Applied Sciences, 2020, 10(17): 5887.Google ScholarA Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (15)Cross Ref
  5. Bai Y, Mao S, Zhou J, Clustered tomato detection and picking point location using machine learning-aided image analysis for automatic robotic harvesting[J]. Precision Agriculture, 2023, 24(2): 727-743.Google ScholarA Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (17)Cross Ref
  6. Yan B, Fan P, Lei X, A real-time apple targets detection method for picking robot based on improved YOLOv5[J]. Remote Sensing, 2021, 13(9): 1619.Google ScholarA Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (19)Cross Ref
  7. Kounalakis N, Kalykakis E, Pettas M, Development of a Tomato Harvesting Robot: Peduncle Recognition and Approaching[C]//2021 3rd International Congress on Human-Computer Interaction, Optimization and Robotic Applications (HORA). IEEE, 2021: 1-6.Google ScholarA Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (21)
  8. Rong Q, Hu C, Hu X, Picking point recognition for ripe tomatoes using semantic segmentation and morphological processing[J]. Computers and Electronics in Agriculture, 2023, 210: 107923.Google ScholarA Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (22)Digital Library
  9. Yu Y, Zhang K, Yang L, Fruit detection for strawberry harvesting robot in non-structural environment based on Mask-RCNN[J]. Computers and Electronics in Agriculture, 2019, 163: 104846.Google ScholarA Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (24)Digital Library
  10. Jia W, Tian Y, Luo R, Detection and segmentation of overlapped fruits based on optimized mask R-CNN application in apple harvesting robot[J]. Computers and Electronics in Agriculture, 2020, 172: 105380.Google ScholarA Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (26)Cross Ref
  11. Jia W, Wei J, Zhang Q, Accurate segmentation of green fruit based on optimized mask RCNN application in complex orchard[J]. Frontiers in Plant Science, 2022, 13: 955256.Google ScholarA Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (28)Cross Ref
  12. Gené-Mola J, Sanz-Cortiella R, Rosell-Polo JR, Morros J-R, Ruiz-Hidalgo J, Vilaplana V, , Gregorio E. 2020. Fuji-SfM dataset: a collection of annotated images and point clouds for Fuji apple detection and location using structure-from-motion photogrammetry.Google ScholarA Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (30)
  13. Gené-Mola J, Sanz-Cortiella R, Rosell-Polo JR, Morros J-R, Ruiz-Hidalgo J, Vilaplana V, , Gregorio E. 2020. Fruit detection and 3D location using instance segmentation neural networks and structure-from-motion photogrammetry. Computers and Electronics in Agriculture, 169 (2020), 105165.Google ScholarA Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (31)
  14. N.R. Pal, On minimum cross-entropy thresholding, Pattern Recognit. 29 (4) (1996) 575–580.Google ScholarA Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (32)Cross Ref
  15. Ji, W.; Liu, D.; Meng, Y.; Liao, Q. Exploring the solutions via retinex enhancements for fruit recognition impacts of outdoor sunlight: A case study of navel oranges. Evol. Intell. 2022, 15, 1875–1911.Google ScholarA Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (34)Cross Ref
  16. Wang, C. Y., Liao, H. Y. M., Wu, Y. H., Chen, P. Y., Hsieh, J. W., and Yeh, I. H. (2020). "CSPNet: A new backbone that can enhance learning capability of CNN," in: Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA, 390-391.Google ScholarA Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (36)
  17. Liu S, Qi L, Qin H, Path aggregation network for instance segmentation[C]//Proceedings of the IEEE conference on computer vision and pattern recognition. 2018: 8759-8768.Google ScholarA Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (37)
  18. Howard A G, Zhu M, Chen B, Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861, 2017.Google ScholarA Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (38)
  19. Chollet F. Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE conference on computer vision and pattern recognition. 2017: 1251-1258.Google ScholarA Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (39)
  20. Zhang X, Zhou X, Lin M, Shufflenet: An extremely efficient convolutional neural network for mobile devices[C]//Proceedings of the IEEE conference on computer vision and pattern recognition. 2018: 6848-6856.Google ScholarA Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (40)
  21. Han K, Wang Y, Tian Q, Ghostnet: More features from cheap operations[C]//Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 2020: 1580-1589.Google ScholarA Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (41)
  22. Bolya D, Zhou C, Xiao F, Yolact: Real-time instance segmentation[C]//Proceedings of the IEEE/CVF international conference on computer vision. 2019: 9157-9166.Google ScholarA Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (42)

Cited By

View all

A Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (43)

    Recommendations

    • Apple HomePod: Master your HomePod, User Guide and Manual

      Read More

    • Apple Watch: The Complete Apple Watch User Guide And Manual - Master Your Apple Watch In 24 Hours Or Less!

      Read More

    • Apple Watch Guide: The unofficial Apple Watch user guide for dummies (With special focus on tips and tricks for optimizing the Apple Watch with your iPhone and Apple TV)

      Read More

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    Get this Publication

    • Information
    • Contributors
    • Published in

      A Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (44)

      CVDL '24: Proceedings of the International Conference on Computer Vision and Deep Learning

      January 2024

      506 pages

      ISBN:9798400718199

      DOI:10.1145/3653804

      Copyright © 2024 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [emailprotected].

      Sponsors

        In-Cooperation

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 1 June 2024

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          A Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (45)

          Qualifiers

          • research-article
          • Research
          • Refereed limited

          Conference

          Funding Sources

          • A Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (46)

            Other Metrics

            View Article Metrics

          • Bibliometrics
          • Citations0
          • Article Metrics

            • Total Citations

              View Citations
            • Total Downloads

            • Downloads (Last 12 months)0
            • Downloads (Last 6 weeks)0

            Other Metrics

            View Author Metrics

          • Cited By

            This publication has not been cited yet

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader

          Digital Edition

          View this article in digital edition.

          View Digital Edition

          HTML Format

          View this article in HTML Format .

          View HTML Format

          • Figures
          • Other

            Close Figure Viewer

            Browse AllReturn

            Caption

            View Table of Contents

            Export Citations

              Your Search Results Download Request

              We are preparing your search results for download ...

              We will inform you here when the file is ready.

              Download now!

              Your Search Results Download Request

              Your file of search results citations is now ready.

              Download now!

              Your Search Results Download Request

              Your search export query has expired. Please try again.

              A Lightweight Apple Fruit Instance Segmentation Network: YOLO-AppleSeg | Proceedings of the International Conference on Computer Vision and Deep Learning (2024)

              References

              Top Articles
              Latest Posts
              Article information

              Author: Patricia Veum II

              Last Updated:

              Views: 6084

              Rating: 4.3 / 5 (44 voted)

              Reviews: 83% of readers found this page helpful

              Author information

              Name: Patricia Veum II

              Birthday: 1994-12-16

              Address: 2064 Little Summit, Goldieton, MS 97651-0862

              Phone: +6873952696715

              Job: Principal Officer

              Hobby: Rafting, Cabaret, Candle making, Jigsaw puzzles, Inline skating, Magic, Graffiti

              Introduction: My name is Patricia Veum II, I am a vast, combative, smiling, famous, inexpensive, zealous, sparkling person who loves writing and wants to share my knowledge and understanding with you.