Up-to-date and accurate maps of the waterways are a prerequisite for safe and efficient shipping in Germany. Authorities such as the Federal Maritime and Hydrographic Agency, but also private harbor operators, are obliged to provide these in an up-to-date form at all times. The main reason for this is to avoid accidents caused by an incorrect or outdated card. This includes the classification of federal waterways, their kilometers, existing locks, lifting and barrages, other surrounding waters, places, and borders. Currently, mapping is carried out by conventional ships with trained personnel, which is time-consuming and expensive. This can result in long intervals between measurements at a particular location.
(Semi-)automated monitoring of waterways by autonomous platforms with obstacle avoidance and traffic detection could optimize this process and provide maps in less time. To this end, the Fraunhofer Institute of Optronics, System Technologies, and Image Exploitation IOSB has developed an autonomous surface vehicle capable of autonomously surveying bodies of water as part of a three-year in-house research project. For this purpose, the riverbed is recorded using sonar. Furthermore, the bank areas and surface structures are monitored by an optical system with two integrated industrial cameras from IDS Imaging Development Systems GmbH. The information obtained in this way is then merged and transferred to a 3D map of the surroundings.
The precise surveying of water bodies is a demanding task. TAPS, the Fraunhofer IOSB’s semi-automatic direction-finding system for rivers and lakes is able to perform this task both under and above water. The vehicle, which measures approximately 2 x 1.5 x 1 meters, travels along the relevant waterway and automatically avoids obstacles, whether stationary or moving. At a speed of 2 knots – which corresponds to around 3.7 kilometers per hour – such a mission can last up to 20 hours. For visual mapping of the shore areas, TAPS has two cameras attached to a mast, each pointing to a starboard or port and whose fields of view do not overlap. Due to their high resolution, they allow a visual inspection of relevant infrastructure, such as quay walls, as well as 3D modeling of the shore area based on the recorded image data.
On the camera side, the Fraunhofer Institute relies on two uEye FA industrial cameras from IDS. The robust and resilient models with PoE are ideal for demanding environments. Camera housings, lens tubes, and screwable connectors meet the requirements of IP code IP65/67 and are thus optimally protected against dirt, dust, and splash water.
The model used has the large-format 1.1″ CMOS sensor IMX304 from Sony and delivers very clear, noise-free images with a resolution of 4096 x 3000 pixels. Thanks to its remarkable dynamic range and very high sensitivity, the global shutter sensor of the second-pixel generation of the Pregius series is particularly suitable for metrology applications, among others.
It was precisely these characteristics that were decisive for the Fraunhofer IOSB’s choice of camera. In addition to robustness and weather protection, important requirements for the cameras included a compact form factor and high image resolution to enable detailed visual inspections. The sensor should also offer a high dynamic range in order to capture images with a high level of detail in both sunny and shady areas. Integration via the standard GigE Vision interface enables the development and use of one driver for several systems with different cameras.
