SeaDronesSee: A Maritime Benchmark for Detecting Humans in Open Water

Unmanned aerial vehicles are helpful in maritime search and rescue missions. Usually, deep neural networks are used for detecting, localizing, and tracking people in open water. However, most training datasets are land-based or do not provide the needed resolution. Therefore, a recent study introduces a large-scale data set of people in open water.

Drone. Image credit: Paul_Henri via Pixabay, CC0 Public Domain

It is carefully annotated into categories like a swimmer, swimmer with a life jacket, person with a life jacket on a boat, or boat. Precise meta information, including altitude, camera angle, speed, and time, is provided for every image. Moreover, near-infrared and red edge spectrum detectors are included. Three challenges are offered: object detection, single-object tracking, and multi-object tracking. The researchers can upload their predictions to an evaluation web page and compare them fairly.

Unmanned Aerial Vehicles (UAVs) are of crucial importance in search and rescue missions in maritime environments due to their flexible and fast operation capabilities. Modern computer vision algorithms are of great interest in aiding such missions. However, they are dependent on large amounts of real-case training data from UAVs, which is only available for traffic scenarios on land. Moreover, current object detection and tracking data sets only provide limited environmental information or none at all, neglecting a valuable source of information. Therefore, this paper introduces a large-scaled visual object detection and tracking benchmark (SeaDronesSee) aiming to bridge the gap from land-based vision systems to sea-based ones. We collect and annotate over 54,000 frames with 400,000 instances captured from various altitudes and viewing angles ranging from 5 to 260 meters and 0 to 90 degrees while providing the respective meta information for altitude, viewing angle and other meta data. We evaluate multiple state- of-the-art computer vision algorithms on this newly established benchmark serving as baselines. We provide an evaluation server where researchers can upload their prediction and compare their results on a central leaderboard.

Research paper: Amadeus Varga, L., Kiefer, B., Messmer, M., and Zell, A., “SeaDronesSee: A Maritime Benchmark for Detecting Humans in Open Water”, 2021. Link:


Notify of
Inline Feedbacks
View all comments
Would love your thoughts, please comment.x