Bio-inspired Endoscope provides 3D Visible and Near-Infrared images simultaneously

New instrument could one day help surgeons more easily pinpoint cancerous tissue. Researchers have developed a new bio-inspired medical endoscope that can acquire 3D visible light and near-infrared fluorescence images at the same time. It features an optical design that combines the high-resolution 3D imaging of human vision with the mantis shrimp’s capability to simultaneously detect multiple wavelengths of light.

Endoscopes with 3D imaging capability can help surgeons precisely locate diseased tissue. Adding fluorescence imaging can make cancerous tissue light up for easier removal or highlight critical parts of the anatomy that need to be avoided during surgery.

In The Optical Society (OSA) journal Optics Express, Chenyoung Shi from the Chinese Academy of Sciences and colleagues describe and demonstrate the new multimodal endoscope. Although this is an early demonstration, the new endoscope is designed to directly replace existing endoscopes without requiring clinicians to learn how to use a new instrument.

“Existing fluorescence 3D endoscopes require surgeons to switch working modes during operation to see the fluorescence images,” said Shi. “Because our 3D endoscope can acquire visible and fluorescent 3D images simultaneously, it not only provides more visual information but can also greatly shorten the operation time and reduce risks during surgery.”

Although it could be used for any endoscopic procedure, the researchers designed the new multimodal endoscope for robotic surgery systems. These systems help increase the precision and accuracy of minimally invasive procedures and can help surgeons perform complicated tasks in confined areas of the body. For robotic surgery, the enhanced visual information provided by the new endoscope could help a surgeon who may be in a different room from the patient clearly distinguish various types of tissue in the surgical field.

“Although today’s robotic surgical systems require the surgeon to be close by, robotic surgery based on this multimodal 3D endoscope might one day allow surgeons to remotely perform procedures in faraway locations,” said Shi. “This could help solve the problem of uneven distribution of medical resources and benefit people who live in areas with relatively poor medical conditions.”

The new multimodal endoscope achieves high-resolution 3D imaging using two optical systems to form a binocular design much like that of human eyes. However, in this case, the optical design can accommodate both visible light like human eyes and the near-infrared wavelengths required for fluorescence imaging. This light is detected by a sensor inspired by the compound eyes of mantis shrimp, which not only detect multispectral information but also recognize polarized light. The sensor detects multiple parts of the electromagnetic spectrum by using pixels with different spectral and polarization responses.

To obtain high-quality 3D images, the binocular optical system must have two optical systems with exactly the same parameters. “This places stringent requirements on the processing accuracy of optical components,” said Shi. “We were able to accomplish this accuracy using precision optical processing and combined this with chip-based spectroscopy technology to make this multimodal 3D endoscope possible.” https://www.osa.org/en-us/about_osa/newsroom/news_releases/2020/bio-inspired_endoscope_provides_3d_visible_and_nea/