Non-Linear co-registration in UAVs’ images using deep learning

• Leandro Henrique Furtado Pinto Silva UFU / UFV
• Jocival Dantas Dias Jünior UFU
• João Fernando Mari UFV
• Mauricio Cunha Escarpinati UFU
• André Ricardo Backes UFU

Resumo

Unmanned Aerial Vehicles (UAVs) has stood out for assisting, enhancing, and optimizing agricultural production. Images captured by UAVs allow a detailed view of the analyzed region since the flight occurs at low and medium altitudes (50m to 400m). In addition, there is a wide variety of sensors (RGB cameras, heat capture sensors, multi and hyperspectral cameras, among others), each with its own characteristics and capable of producing different information. In multi-spectral images acquisition, we use a distinct sensor to capture each image band and at different time, leading to misalignments. To tackle this problem we propose to train a deep neural network to predict the vector deformation fields to perform the registration between bands of a multi-spectral image. The proposed approach has an accuracy ranging from 89.90% to 93.79% in the task of estimating the displacement field between bands. With this field estimated by the network, it is possible to register between the bands without the need for manual marking of points.

Palavras-chave: Training, Deep learning, Visualization, Vegetation mapping, Manuals, Sensor phenomena and characterization, Cameras