Intelligent microscope developed for detecting rare biological events

Intelligent microscope developed for detecting rare biological events

An intelligent microscope that improves a researcher’s ability to detect rare biological events, has been developed by biophysicists in Switzerland.

Biophysicists at the Swiss Federal Institute of Technology (EPFL) in Lausanne, have found a way to automate microscope control for imaging biological events in detail while limiting stress on the sample, all with the help of artificial neural networks. The technique works for bacterial cell division, and for mitochondrial division.

Principal investigator Suliana Manley of EPFL’s Laboratory of Experimental Biophysics, explained: “An intelligent microscope is kind of like a self-driving car. It needs to process certain types of information, subtle patterns that it then responds to by changing its behaviour. By using a neural network, we can detect much more subtle events and use them to drive changes in acquisition speed.”

Manley and her colleagues first solved how to detect mitochondrial division, which is more difficult than for bacteria such as C. crescentus. Mitochondrial division is unpredictable, since it occurs infrequently, and can happen almost anywhere within the mitochondrial network at any moment.

But the scientists solved the problem by training the neural network to look out for mitochondrial constrictions, a change in shape of mitochondria that leads to division, combined with observations of a protein known to be enriched at sites of division.

Intelligent fluorescent microscope

When both constrictions and protein levels are high, the microscope switches into high-speed imaging to capture many images of division events in detail. When constriction and protein levels are low, the microscope then switches to low-speed imaging to avoid exposing the sample to excessive light.

With this intelligent fluorescent microscope, the scientists showed that they could observe the sample for longer compared to standard fast imaging. While the sample was more stressed compared to standard slow imaging, they were able to obtain more meaningful data.

Manley added: “The potential of intelligent microscopy includes measuring what standard acquisitions would miss. We capture more events, measure smaller constrictions, and can follow each division in greater detail.”

The scientists are making the control framework available as an open-source plug-in for the open microscope software Micro-Manager, with the aim of allowing other scientists to integrate artificial intelligence into their own microscopes.

Details of the intelligent microscope are described in the journal Nature Methods.

Suliana Manley’s fluorescent microscope at EPFL. Credit: Hillary Sanctuary / EPFL

Leave a reply

Your email address will not be published. Required fields are marked *

Aether: Issue 3 Feb 2023

Aether: Issue 2 Nov 2022

Aether: Issue 1 Aug 2022

Subscribe for free

Latest Testimonial

What a beautiful motto: Discoveries must be read and not just published. When I was contacted by Aether as a new digital service to share scientific and technological insights I had my doubts that this was really going to be according to what I call the “open source & makers’ spirit”: knowledge should be free and it is there to be shared.

Well, Aether is faithful to its motto and shares discoveries freely. It has been a pleasure to collaborate for the interview and subsequent article. It has been greatly self satisfying to see how the interview was professionally and truthfully redacted and then published. Sharing thoughts and sparks for discussions is fundamental to the progress of society. Your journal offers clarity and brevity and I believe it provides the sparks to ignite any reader whether academic or not into action.

Dr Maria-Cristina Ciocci
Co-founder and Manager of non-profit organisation De Creative STEM,GirlsInSTEM