Exemple data for 2D image annotations onto 3D models

DOI

Imagery has become one of the main data sources for investigating seascape spatial patterns. This is particularly true in deep-sea environments, which are only accessible with underwater vehicles. On the one hand, using collaborative web-based tools and machine learning algorithms, biological and geological features can now be massively annotated on 2D images with the support of experts. On the other hand, geomorphometrics such as slope or rugosity derived from 3D models built with structure from motion (sfm) methodology can then be used to answer spatial distribution questions. However, precise georeferencing of 2D annotations on 3D models has proven challenging for deep-sea images, due to a large mismatch between navigation obtained from underwater vehicles and the reprojected navigation computed in the process of 3D building. In addition, although 3D models can be directly annotated, the process becomes challenging due to the low resolution of textures and the large size of the models. In this article, we propose a streamlined, open-access processing pipeline to reproject 2D image annotations onto 3D models using ray tracing. Using four underwater image data sets, we assessed the accuracy of annotation reprojection on 3D models and achieved successful georeferencing to centimetric accuracy. The combination of photogrammetric 3D models and accurate 2D annotations would allow the construction of a 3D representation of the landscape and could provide new insights into understanding species microdistribution and biotic interactions. The dataset contains 4 compressed volumes corresponding to the 4 study sites used in this study. Each volume contains a 3D mesh (.ply), a 3D textured mesh (.obj, .mtl, and textures), an optical navigation file (.json) and the set of images used for the evaluation of reprojection accuracy. The files were generated using Matisse 3D V1.4 3D reconstruction software. The dataset also contains a Biiigle annotation report (.csv) correponding to fauna annotation.

Identifier
DOI https://doi.org/10.17882/99108
Metadata Access http://www.seanoe.org/oai/OAIHandler?verb=GetRecord&metadataPrefix=oai_dc&identifier=oai:seanoe.org:99108
Provenance
Creator Marcillat, Marin; Menot, Lenaick; Van Audenhaege, Loic; Borremans, Catherine
Publisher SEANOE
Publication Year 2024
Rights CC-BY-NC-SA
OpenAccess true
Contact SEANOE
Representation
Resource Type Dataset
Discipline Marine Science