Augmented Reality Helps Locate Hidden Tumors During Liver Surgery

Tumors beneath the liver surface can be difficult to locate during laparoscopic surgery, as these keyhole procedures provide limited visual access to deeper tissue. Surgeons must therefore rely on preoperative imaging and camera views to navigate around lesions hidden from direct view. To improve guidance during these procedures, researchers have developed interactive 3D augmented reality technology designed to reveal the location of subsurface tumors during liver surgery.

The technology was developed through collaboration involving Chalmers University of Technology, the University of Gothenburg, and Sahlgrenska University Hospital. It overlays a 3D visualization of the tumor and other anatomical structures onto the surgeon’s camera view. The display updates as the camera changes position, giving the surgical team continuous guidance during the procedure.

The system uses a special sticker placed on the liver surface. The sticker is about one square centimeter and contains a QR code. As long as the surgical camera can detect the marker, the system can show the expected location of tumors or other structures beneath the surface.

The marker functions as an artificial landmark on an otherwise smooth liver surface. Its position is combined with the camera location and preoperative X-ray imaging to calculate where the tumor should appear. That information is then overlaid on the live camera view for intraoperative orientation.

The technology was used in surgery on a patient for the first time in June 2026. The system was used as planned during the operation, and the workflow was reported to have functioned well. The patient was able to go home the following day.

Further liver operations are planned for fall 2026. Work is also continuing on clinical validation, product development, quality management systems, and steps needed for regulatory approval. A larger international study is planned with the Intervention Centre at Oslo University Hospital and hospitals in Washington.

“This technology can be used in many routine procedures, for tumors in other organs or to keep track of a particular anatomical structure. We are starting with liver surgery, but in the longer term the technology could have much broader applications,” said Niclas Kvarnström, transplant surgeon and head of the Transplant Centre at Sahlgrenska University Hospital, and a researcher at Sahlgrenska Academy at the University of Gothenburg.

Related Links
Chalmers University of Technology
University of Gothenburg
Sahlgrenska University Hospital