Giacomo De Rossi Marco Minelli, Serena Roin Fabio Falezza Alessio Sozzi Federica Ferraguti Francesco Setti Marcello Bonfè Cristian Secchi Riccardo Muradore A First Evaluation of a Multi-Modal Learning System to Control Surgical Assistant Robots via Action Segmentation Journal Article IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS, 3 (3), pp. 714-724, 2021, ISSN: 2576-3202. Abstract | Links | BibTeX | Tags: Action segmentation, Cognitive robotics, Medical robotics, Model-predictive control, R-MIS Andrea Roberti Nicola Piccinelli, Daniele Meli Riccardo Muradore ; Paolo Fiorini, Improving Rigid 3-D Calibration for Robotic Surgery Journal Article IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS, 2 (4), pp. 569-573, 2020, ISBN: 2576-3202. Abstract | Links | BibTeX | Tags: Calibration, Medical robotics, Minimally invasive surgery, multi arm calibration, Robot, Robot vision systems, Surgery, Surgical robotics, Three-dimensional displays Narcís Sayols Alessio Sozzi, Nicola Piccinelli Albert Hernansanz Alicia Casals Marcello Bonfè ; Riccardo Muradore, 2020 IEEE International Conference on Robotics and Automation (ICRA), 2020. Abstract | Links | BibTeX | Tags: assistive tasks, autonomous execution, autonomous surgical, Collision avoidance, collision free connections, collision-free trajectories, desired task, developed motion planner, dynamical systems based obstacle avoidance, final target, geometric constraints, global level computes smooth spline-based trajectories, Medical robotics, mobile robots, motion control, moving obstacles, realistic surgical scenario, Robots, splines (mathematics), Surgery, surgery INSPEC: Non-Controlled Indexing robotic minimally invasive surgery, Task analysis, Tools, Trajectory, two-layer architecture Giacomo De Rossi Marco Minelli, Alessio Sozzi Nicola Piccinelli Federica Ferraguti Francesco Setti Marcello Bonfé Christian Secchi Riccardo Muradore 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, 2020, ISBN: 978-1-7281-4004-9. Abstract | Links | BibTeX | Tags: Artificial Intelligence, Collision avoidance, Manipulators, Medical robotics, mobile robots, predictive control, Robot, Robot vision, Surgery, trajectory control, uncertain systems Oleari, Elettra; Leporini, Alice; Trojaniello, Diana; Sanna, Alberto; Capitanio, Umberto; Deho, Federico; Larcher, Alessandro; Montorsi, Francesco; Salonia, Andrea; Setti, Francesco; Muradore, Riccardo Enhancing Surgical Process Modeling for Artificial Intelligence Development in Robotics the SARAS Case Study for Minimally Invasive Procedures Journal Article pp. 1-6, 2019, ISBN: 978-1-7281-2342-4. Abstract | Links | BibTeX | Tags: Artificial Intelligence, Autonomy, Cognitive control, Cognitive functions, Decision making, Laparoscopes, Laparoscopy, Laparoscopy, learning systems, machine learning, Medical robotics, multirobots teleoperated platform, Robotic surgery, Surgery, Surgical robots, Teleoperation
2021
title = {A First Evaluation of a Multi-Modal Learning System to Control Surgical Assistant Robots via Action Segmentation},
author = {Giacomo De Rossi, Marco Minelli, Serena Roin, Fabio Falezza, Alessio Sozzi, Federica Ferraguti, Francesco Setti, Marcello Bonfè, Cristian Secchi, Riccardo Muradore},
editor = {IEEE },
doi = {10.1109/TMRB.2021.3082210},
issn = {2576-3202},
year = {2021},
date = {2021-05-21},
journal = {IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS},
volume = {3},
number = {3},
pages = {714-724},
abstract = {The next stage for robotics development is to introduce autonomy and cooperation with human agents in tasks that require high levels of precision and/or that exert considerable physical strain. To guarantee the highest possible safety standards, the best approach is to devise a deterministic automaton that performs identically for each operation. Clearly, such approach inevitably fails to adapt itself to changing environments or different human companions. In a surgical scenario, the highest variability happens for the timing of different actions performed within the same phases. This paper presents a cognitive control architecture that uses a multi-modal neural network trained on a cooperative task performed by human surgeons and produces an action segmentation that provides the required timing for actions while maintaining full phase execution control via a deterministic Supervisory Controller and full execution safety by a velocity-constrained Model Predictive Controller.},
keywords = {Action segmentation, Cognitive robotics, Medical robotics, Model-predictive control, R-MIS},
pubstate = {published},
tppubtype = {article}
}
2020
title = {Improving Rigid 3-D Calibration for Robotic Surgery},
author = {Andrea Roberti , Nicola Piccinelli , Daniele Meli, Riccardo Muradore , and Paolo Fiorini ,},
editor = {IEEE },
doi = {10.1109/TMRB.2020.3033670},
isbn = {2576-3202},
year = {2020},
date = {2020-11-04},
journal = {IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS},
volume = {2},
number = {4},
pages = {569-573},
abstract = {Autonomy is the next frontier of research in robotic surgery and its aim is to improve the quality of surgical procedures in the next future. One fundamental requirement for autonomy is advanced perception capability through vision sensors. In this article, we propose a novel calibration technique for a surgical scenario with a da Vinci ® Research Kit (dVRK) robot. Camera and robotic arms calibration are necessary to precise position and emulate expert surgeon. The novel calibration technique is tailored for RGB-D cameras. Different tests performed on relevant use cases prove that we significantly improve precision and accuracy with respect to state of the art solutions for similar devices on a surgical-size setups. Moreover, our calibration method can be easily extended to standard surgical endoscope used in real surgical scenario.},
keywords = {Calibration, Medical robotics, Minimally invasive surgery, multi arm calibration, Robot, Robot vision systems, Surgery, Surgical robotics, Three-dimensional displays},
pubstate = {published},
tppubtype = {article}
}
title = {Global/local motion planning based on Dynamic Trajectory Reconfiguration and Dynamical Systems for autonomous surgical robots},
author = {Narcís Sayols, Alessio Sozzi, Nicola Piccinelli, Albert Hernansanz, Alicia Casals, Marcello Bonfè, and Riccardo Muradore,},
editor = {IEEE},
doi = {10.1109/ICRA40945.2020.9197525},
year = {2020},
date = {2020-09-15},
booktitle = {2020 IEEE International Conference on Robotics and Automation (ICRA)},
abstract = {This paper addresses the generation of collision-free trajectories for the autonomous execution of assistive tasks in Robotic Minimally Invasive Surgery (R-MIS). The proposed approach takes into account geometric constraints related to the desired task, like for example the direction to approach the final target and the presence of moving obstacles. The developed motion planner is structured as a two-layer architecture: a global level computes smooth spline-based trajectories that are continuously updated using virtual potential fields; a local level, exploiting Dynamical Systems based obstacle avoidance, ensures collision free connections among the spline control points. The proposed architecture is validated in a realistic surgical scenario.},
keywords = {assistive tasks, autonomous execution, autonomous surgical, Collision avoidance, collision free connections, collision-free trajectories, desired task, developed motion planner, dynamical systems based obstacle avoidance, final target, geometric constraints, global level computes smooth spline-based trajectories, Medical robotics, mobile robots, motion control, moving obstacles, realistic surgical scenario, Robots, splines (mathematics), Surgery, surgery INSPEC: Non-Controlled Indexing robotic minimally invasive surgery, Task analysis, Tools, Trajectory, two-layer architecture},
pubstate = {published},
tppubtype = {conference}
}
title = {Cognitive Robotic Architecture for Semi-Autonomous Execution of Manipulation Tasks in a Surgical Environment},
author = {Giacomo De Rossi, Marco Minelli, Alessio Sozzi, Nicola Piccinelli, Federica Ferraguti, Francesco Setti, Marcello Bonfé, Christian Secchi, Riccardo Muradore},
editor = {IEEE International Intelligent Robots and Systems (IROS)},
doi = {10.1109/IROS40897.2019.8967667},
isbn = {978-1-7281-4004-9},
year = {2020},
date = {2020-01-27},
booktitle = {2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)},
publisher = {IEEE},
abstract = {The development of robotic systems with a certain level of autonomy to be used in critical scenarios, such as an operating room, necessarily requires a seamless integration of multiple state-of-the-art technologies. In this paper we propose a cognitive robotic architecture that is able to help an operator accomplish a specific task. The architecture integrates an action recognition module to understand the scene, a supervisory control to make decisions, and a model predictive control to plan collision-free trajectory for the robotic arm taking into account obstacles and model uncertainty. The proposed approach has been validated on a simplified scenario involving only a da VinciO surgical robot and a novel manipulator holding standard laparoscopic tools.},
keywords = {Artificial Intelligence, Collision avoidance, Manipulators, Medical robotics, mobile robots, predictive control, Robot, Robot vision, Surgery, trajectory control, uncertain systems},
pubstate = {published},
tppubtype = {conference}
}
2019
title = {Enhancing Surgical Process Modeling for Artificial Intelligence Development in Robotics the SARAS Case Study for Minimally Invasive Procedures},
author = {Elettra Oleari and Alice Leporini and Diana Trojaniello and Alberto Sanna and Umberto Capitanio and Federico Deho and Alessandro Larcher and Francesco Montorsi and Andrea Salonia and Francesco Setti and Riccardo Muradore},
editor = {IEEE},
doi = {10.1109/ISMICT.2019.8743931},
isbn = {978-1-7281-2342-4},
year = {2019},
date = {2019-05-09},
pages = {1-6},
abstract = {Nowadays Minimally Invasive Surgery (MIS) is playing an increasingly major role in the clinical practice also thanks to a rapid evolution of the available medical technologies, especially surgical robotics. A new challenge in this respect is to equip robots with cognitive capabilities, in order to make them able to act autonomously and cooperate with human surgeons. In this paper we describe the methodological approach developed to comprehensively describe a specific surgical knowledge, to be transferred to a complex Artificial Intelligence (AI) integrating Perception, Cognitive and Planning modules. Starting from desk researches and a strict cooperation with expert surgeons, the surgical process is framed on a high-level perspective, which is then deepened into a granular model through a Surgical Process Modelling approach, so as to embed all of the needed information by the AI to properly work. The model is eventually completed adding the corresponding Process Risk Analysis. We present the results obtained with the application of the aforementioned methodology to a Laparoscopic Radical Nephrectomy (LRN) procedure and discuss on the next technical implementation of this model.},
keywords = {Artificial Intelligence, Autonomy, Cognitive control, Cognitive functions, Decision making, Laparoscopes, Laparoscopy, Laparoscopy, learning systems, machine learning, Medical robotics, multirobots teleoperated platform, Robotic surgery, Surgery, Surgical robots, Teleoperation},
pubstate = {published},
tppubtype = {article}
}
A First Evaluation of a Multi-Modal Learning System to Control Surgical Assistant Robots via Action Segmentation Journal Article IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS, 3 (3), pp. 714-724, 2021, ISSN: 2576-3202. Improving Rigid 3-D Calibration for Robotic Surgery Journal Article IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS, 2 (4), pp. 569-573, 2020, ISBN: 2576-3202. 2020 IEEE International Conference on Robotics and Automation (ICRA), 2020. 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, 2020, ISBN: 978-1-7281-4004-9. Enhancing Surgical Process Modeling for Artificial Intelligence Development in Robotics the SARAS Case Study for Minimally Invasive Procedures Journal Article pp. 1-6, 2019, ISBN: 978-1-7281-2342-4.
2021
2020
2019