The robot navigates autonomously through the field, meaning the farmer's effort is reduced to a minimum. Photo: IDS
The robot navigates autonomously through the field, meaning the farmer’s effort is reduced to a minimum. Photo: IDS

Robot with IDS camera eliminates the need for herbicides

Development Systems GmbH
The robot navigates autonomously through the field, meaning the farmer's effort is reduced to a minimum. Photo: IDS
The robot navigates autonomously through the field, meaning the farmer’s effort is reduced to a minimum. Photo: IDS

An intelligent robot has been developed to reduce the use of herbicides in agriculture. Through the use of a robust industrial camera from IDS, the robot has been enhanced further.

Plant protection products are an integral part of today’s agriculture. They are intended to protect crops and keep out weeds and pests. In 2019, according to the German Federal Environment Agency, the group of herbicides (weed killers) accounted for 50.6 % of the plant protection products dispensed. Unfortunately, in addition to the desired effect, these also harbour numerous risks for humans and the environment.

Robot Rosie

The Rowesys student project was launched 2019 at the Swiss Federal Institute of Technology (ETH) Zurich with the aim of developing a robot for more sustainable agriculture without the excessive use of herbicides. On the underside of the robot is a uEye+ industrial camera with GigE Vision interface from IDS Imaging Development Systems GmbH.

The team, consisting of 10 students of electrical engineering, mechanical engineering and industrial design, constructed a first functional prototype called Rosie within only 9 months. The robot consists of an outer shell that protects all components inside the housing. Its interior has two powerful batteries and a control box that contains most of the system’s electrical components. A structure made of aluminium profiles forms the skeleton of the robot. With the help of 4 small, individually sprung goose-foot spades, Rosie removes weeds from between the sown plants in a purely mechanical way. They are pulled through the soil behind the robot to the left and right of the rows of plants. This means that the use of environmentally harmful herbicides can be dispensed with. Since the robot navigates autonomously through the field, the farmer’s effort is reduced to a minimum. At the same time, smooth, intuitive control is also possible via a joystick.

Rosie has been developed to eliminate the use of herbicides in the agriculture sector. Photo: IDS
Rosie has been developed to eliminate the use of herbicides in the agriculture sector. Photo: IDS

Clever cameras and sensors

To navigate autonomously, Rosie must first be able to perceive the exact position as well as the end of a row of plants. The robot has several cameras and sensors as well as algorithms for path and position recognition. Based on the data obtained, it always moves along the recognised row within the field. When it reaches the end, it switches to turning mode and finds the next row. This is done until the entire field has been worked. Thanks to four motors, each wheel can be controlled individually. This makes Rosie very mobile and allows a full turn on the spot.

The team is currently working on the further development and optimisation of the system. Various monitoring tasks are on the agenda. The aim is to observe plants over a longer period of time in order to provide the farmer or breeder e.g. with information on their growth behaviour. For this purpose, Rosie was additionally equipped with a robust IDS industrial camera. “Using the images, we distinguish between weeds and crops for herbicide-free weed removal.” An active tool below the robot should then also be able to remove weeds directly around the plants.

Clever placement of the IDS camera means that it captures images of the plants from above. Photo: IDS
Clever placement of the IDS camera means that it captures images of the plants from above. Photo: IDS

Early measures

The camera is mounted on the underside of the robot and is oriented vertically downwards. While the robot drives through the fields, it captures the plants from the top. By means of neural networks, the above analyses can be carried out depending on the application. In the future, this information should help farmers to be able to take measures at an early stage, e.g. against fungal infestation. Rosie has so far been used for field trials in sugar beet, wheat and maize fields.

Sustainable and efficient future

Agricultural robots will play an increasingly important role in the future. In order to be able to reliably perform the various tasks in any environment and in different light and weather conditions, they need not only good image processing software, but above all reliable cameras. The use of such camera systems on future robots will be very diverse – from 3D to multispectral cameras. The Rowesys team will continue to work on intelligent, camera-based solutions in the future and contribute to more sustainable and efficient agriculture with innovative technologies.

Development Systems GmbH
Imaging Development Systems GmbH Partner profile

Imaging Development Systems GmbH develops high-performance, easy-to-use USB, GigE and 3D cameras with a wide spectrum of sensors and variants. The almost unlimited range of applications covers multiple non-industrial and industrial sectors in the field of equipment, plant and mechanical engineering. In addition to the successful CMOS cameras, the company expands its portfolio with vision app-based, intelligent cameras. The novel image processing platform IDS NXT is freely programmable and extremely versatile. Since its foundation in 1997 as a two-man company, IDS has developed into an independent, ISO-certified family business with more than 330 employees. The headquarters in Obersulm, Germany, is both a development and production site. With branches in the USA, Japan, South Korea and UK as well as other offices, IDS is represented internationally. For more info visit: https://en.ids-imaging.com/

Development Systems GmbH
Imaging Development Systems GmbH Partner profile

Imaging Development Systems GmbH develops high-performance, easy-to-use USB, GigE and 3D cameras with a wide spectrum of sensors and variants. The almost unlimited range of applications covers multiple non-industrial and industrial sectors in the field of equipment, plant and mechanical engineering. In addition to the successful CMOS cameras, the company expands its portfolio with vision app-based, intelligent cameras. The novel image processing platform IDS NXT is freely programmable and extremely versatile. Since its foundation in 1997 as a two-man company, IDS has developed into an independent, ISO-certified family business with more than 330 employees. The headquarters in Obersulm, Germany, is both a development and production site. With branches in the USA, Japan, South Korea and UK as well as other offices, IDS is represented internationally. For more info visit: https://en.ids-imaging.com/

Beheer