Plant protection products are an integral part of today’s agriculture. They are intended to protect crops and keep out weeds and pests. In 2019, according to the German Federal Environment Agency, the group of herbicides (weed killers) accounted for 50.6 % of the plant protection products dispensed. Unfortunately, in addition to the desired effect, these also harbour numerous risks for humans and the environment. The Rowesys student project was launched in summer 2019 at the Swiss Federal Institute of Technology (ETH) Zurich with the aim of developing a robot for more sustainable agriculture without the excessive use of herbicides. On the underside of the robot is a uEye+ industrial camera with GigE Vision interface from IDS Imaging Development Systems GmbH.
The team, consisting of ten students of electrical engineering, mechanical engineering and industrial design, constructed a first functional prototype called Rosie within only nine months. The robot consists of an outer shell that protects all components inside the housing. Its interior has two powerful batteries and a control box that contains most of the system’s electrical components. A structure made of aluminium profiles forms the skeleton of the robot. With the help of four small, individually sprung goose-foot spades, Rosie removes weeds from between the sown plants in a purely mechanical way. They are pulled through the soil behind the robot to the left and right of the rows of plants. This means that the use of environmentally harmful herbicides can be dispensed with. Since the robot navigates autonomously through the field, the farmer’s effort is reduced to a minimum. At the same time, smooth, intuitive control is also possible via a joystick.
In order to navigate autonomously, Rosie must first be able to perceive the exact position as well as the end of a row of plants. The robot has several cameras and sensors as well as algorithms for path and position recognition. Based on the data obtained, it always moves along the recognised row within the field. When it reaches the end, it switches to turning mode and finds the next row. This is done until the entire field has been worked. Thanks to four motors, each wheel can be controlled individually. This makes Rosie very mobile and allows a full turn on the spot.
The team is currently working on the further development and optimisation of the system. Various monitoring tasks are on the agenda. The aim is to observe plants over a longer period of time in order to provide the farmer or breeder e.g. with information on their growth behaviour. For this purpose, Rosie was additionally equipped with a robust IDS industrial camera of the uEye FA series. “Using the images, we distinguish between weeds and crops for herbicide-free weed removal.” An active tool below the robot should then also be able to remove weeds directly around the plants.
The camera (IP65/67) is mounted on the underside of the robot and is oriented vertically downwards. While the robot drives through the fields, it captures the plants from the top. By means of neural networks, the above analyses can be carried out depending on the application. In the future, this information should help farmers to be able to take measures at an early stage, e.g. against fungal infestation. Rosie has so far been used for field trials in sugar beet, wheat and maize fields. The camera model used must meet special specifications for use in the field. “For our evaluations, we need a camera with a high-resolution colour sensor and low exposure time for sharp images, despite the constant movement of the robot. Since it can also be exposed to harsh conditions in the fields, depending on the weather, it also has to be protected against dust and splash water,” explains Timo Schönegg. Other selection criteria were compatibility with Linux/ROS, a compact size and fast data transmission for short response times. The possibility of using wide-angle lenses also had to be given.
Agricultural robots will play an increasingly important role in the future. In order to be able to reliably perform the various tasks in any environment and in different light and weather conditions, they need not only good image processing software, but above all reliable cameras. The use of such camera systems on future robots will be very diverse – from 3D CLK / 21.03.2022 / S. 2 to multispectral cameras. The Rowesys team will continue to work in particular on intelligent, camera-based solutions in the future and contribute to more sustainable and efficient agriculture with innovative technologies.
IDS Imaging Development Systems Limited
Landmark House, Station Road
RG27 9HA Hook
United Kingdom
Phone: +44 1256 962910
uksales@ids-imaging.com
www.ids-imaging.com
