Precision weed detection via colour and depth data fusion in real-time for automatic spot spraying

Rees, Steven (2015) Precision weed detection via colour and depth data fusion in real-time for automatic spot spraying. [Thesis (PhD/Research)]

Text (Whole Thesis)

Download (4MB) | Preview


Broadacre and row crop farming in Australia uses no-till and minimum-till farming systems which have led to the overuse of specific herbicides for weed control,
causing resistance to those specific herbicides to build-up in weeds. Automatic weed spot spraying can help reduce resistance build-up by specifically detecting weeds for targeted control with alternative herbicides, hence breaking the resistance cycle. Existing commercial weed spot sprayers are only capable of distinguishing green from brown, i.e. plant material in a fallow situation, and image
analysis research for weed discrimination typically was not developed for commercial on-farm conditions. The research in this thesis has developed a real-time, real-world machine vision spot spray system that can operate at groundspeeds up to 20 km/h and discriminate green from green (i.e. weed from crop) under commercial conditions for two very different crop types and size scales, specifically
sugarcane (grass-like) and pyrethrum (broadleaf).

Occlusion of a weed leaf by another leaf or plant is a major impediment for real-world operation of a machine vision weed spot sprayer. A Depth Colour Segmentation Algorithm (DCSA) has been developed which combines depth data and colour image data to segment individual leaves from each other, based on pixel connectedness in height and colour, providing an accuracy when occluded of greater than 99%. The DCSA has a �filtering capability that can reduce the amount of data requiring further analysis by an observed 83% for sugarcane and 53% for pyrethrum.

Existing feature extraction techniques have been evaluated in the thesis and have been shown to be unsatisfactory in discriminating weed from crop especially when the weed and crop are similar species, e.g. grass-like weed (guinea grass) from grass-like crop (sugarcane). Depth features were added to the extracted features of a local binary pattern function, improving the accuracy from 63% to 90% for pyrethrum identification, and showing that depth data combined with 2D data can improve the discrimination result. Additional real-world custom algorithms have been
developed to achieve an identification accuracy of 87% (where 86% of the weed was occluded) with a 3.5% false positive rate for sugarcane. The Depth, Colour, Size and Spatial (DCSS) algorithm developed for pyrethrum achieved
98% accuracy for pyrethrum identification with a 1.2% false positive rate.

Real-time functionality has been obtained by the development of a Synchronised Parallel Processing
(SPP) technique. The SPP technique maintains a high frame rate (which determines the maximum groundspeed) by assigning the workload in a permanently allocated pipeline synchronised by the incoming video image. Calculations for sugarcane and pyrethrum show that speeds up to 18.5 and 17.2 km/h respectively are achievable based on the algorithms developed and a higher core count CPU
(six cores were used in the calculation) would achieve higher groundspeeds. The gains from the additional processing availability provided by SPP can be used to achieve a higher groundspeed, or undertake additional image analysis, if required.

It is concluded that the machine vision components developed in this thesis comprise a real-time,
real-world machine vision spot sprayer that can operate at commercial groundspeeds up to 20 km/h and discriminate weed from crop.

Statistics for USQ ePrint 34246
Statistics for this ePrint Item
Item Type: Thesis (PhD/Research)
Item Status: Live Archive
Additional Information: Doctor of Philosophy (PhD) thesis.
Faculty/School / Institute/Centre: No Faculty
Faculty/School / Institute/Centre: No Faculty
Supervisors: McCarthy, Cheryl; Hancock, Nigel
Date Deposited: 05 Jun 2018 06:01
Last Modified: 05 Jun 2018 06:01
Uncontrolled Keywords: weed detection; machine vision; image analysis; line detection; spot spraying
Fields of Research (2008): 08 Information and Computing Sciences > 0801 Artificial Intelligence and Image Processing > 080104 Computer Vision
09 Engineering > 0913 Mechanical Engineering > 091302 Automation and Control Engineering
07 Agricultural and Veterinary Sciences > 0703 Crop and Pasture Production > 070308 Crop and Pasture Protection (Pests, Diseases and Weeds)
Fields of Research (2020): 46 INFORMATION AND COMPUTING SCIENCES > 4603 Computer vision and multimedia computation > 460304 Computer vision
40 ENGINEERING > 4007 Control engineering, mechatronics and robotics > 400799 Control engineering, mechatronics and robotics not elsewhere classified
30 AGRICULTURAL, VETERINARY AND FOOD SCIENCES > 3004 Crop and pasture production > 300409 Crop and pasture protection (incl. pests, diseases and weeds)

Actions (login required)

View Item Archive Repository Staff Only