University of Limerick
Santos_2023_Fully.pdf (5.07 MB)
Download file

Fully automatic visual servoing control for underwater vehiclemanipulator systems based on a heuristic inverse kinematics

Download (5.07 MB)
journal contribution
posted on 2023-09-15, 07:17 authored by Phillipe SantosPhillipe Santos, Raimundo C. S. Freire, Elyson Adam Nunes CARVALHO, Lucas Molina, Eduardo O. Freire, Matheus SantosMatheus Santos, ANTHONY WEIRANTHONY WEIR, Petar TrslicPetar Trslic, EDIN OMERDICEDIN OMERDIC, GERARD DOOLYGERARD DOOLY, DANIEL TOALDANIEL TOAL

The use of underwater vehicle manipulator systems (UVMS) equipped with cameras has gained significant attention due to their capacity to perform underwater tasks autonomously. However, controlling both the manipulator and the remotely operated vehicle (ROV) based on the vision system information is not an easy task, especially in situations where the vehicle cannot be parked/held stationary. Most of the existing approaches work based on complex matrix calculations for the inverse kinematics (IK), which can lead to high computational costs and the need to deal with singularity problems. A problem arises when the amount of time needed to calculate the UVMS configuration can result in reduced frequency of target pose estimation, beyond the point where the target has moved out of the camera field of view. Therefore, this paper proposes an autonomous visual servoing approach for UVMS, including an extension of a heuristic technique named M-FABRIK (Mobile - Forward and Backward Reaching IK) to calculate the UVMS inverse kinematics in a simple and fast way. This approach aims to control both the configuration of the manipulator and ROV position in order to allow underwater intervention in situations where the ROV cannot be parked/held stationary. This solution allows the vehicle to be positioned according to additional criteria, besides avoiding matrix inversion and being robust to singularities. Trials have been performed with a manipulator mounted on a work-class ROV for an autonomous underwater monitoring task and results demonstrate a simple and fast approach, which is able to set the configuration of the manipulator as well as the ROV for visual servoing applications in real-time, such as for monitoring, tracking and intervention tasks underwater.


Observation and Monitoring of Marine Renewable Energy Infrastructure (OM-MaREI)

Science Foundation Ireland

Find out more...

Lero - the Irish Software Research Centre

Science Foundation Ireland

Find out more...

Confirm Centre for Smart Manufacturing

Science Foundation Ireland

Find out more...



Journal of Intelligent & Robotic Systems 107, 42



Other Funding information

IReL Consortium Coordenacao de Aperfeicoamento de Pessoal de Nıvel Superior - Brasil (CAPES) under Grant Finance Code 001 and SEAI Research, Development and Demonstration Funding Programme 2021

Sustainable development goals

  • (9) Industry, Innovation and Infrastructure

Department or School

  • Electronic & Computer Engineering

Usage metrics

    University of Limerick