A surgical robot with cognitive functions

SARAS will develop a cognitive architecture able to make decisions based on pre-operative knowledge and on scene understanding via advanced machine learning algorithms.

Training Data Collection – Assistant surgeon’s master console.

Dexterity and perception capabilities of surgical robots may soon be improved by cognitive functions that can support surgeons in decision making and performance monitoring, and enhance the impact of automation within the operating rooms.

Nowadays, the basic elements of autonomy in robotic surgery are still not well understood and their mutual interaction is unexplored.

Current classification of autonomy encompasses six basic levels:

  • Level 0: no autonomy;
  • Level 1: robot assistance;
  • Level 2: task autonomy;
  • Level 3: conditional autonomy;
  • Level 4: high autonomy;
  • Level 5: full autonomy.

The practical meaning of each level and the necessary technologies to move from one level to the next are the subject of intense debate and development.

In the paper “A Multirobots Teleoperated Platform for Artificial Intelligence Training Data Collection in Minimally Invasive Surgery” we discuss the first outcomes of the European funded project Smart Autonomous Robotic Assistant Surgeon (SARAS). SARAS will develope a cognitive architecture able to make decisions based on pre-operative knowledge and on scene understanding via advanced machine learning algorithms.

To reach this ambitious goal that allows us to reach Level 1 and 2, it is of paramount importance to collect reliable data to train the algorithms. We will present the experimental setup to collect the data for a complex surgical procedure (Robotic Assisted Radical Prostatectomy) on very sophisticated manikins (i.e. phantoms of the inflated human abdomen).

The SARAS platform allows the main surgeon and the assistant to teleoperate two independent two-arm robots. The data acquired with this platform (videos, kinematics, audio) will be used in our project and will be released (with annotations) for research purposes.

Authors: Francesco Setti, Elettra Oleari, Alice Leporini, Diana Trojaniello, Alberto Sanna, Umberto Capitanio, Francesco Montorsi, Andrea Salonia and Riccardo Muradore

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.