A new AI tool produces faster, more realistic images of space than current methods, thus ‘unblurring the cosmos’
The cosmos would look a lot better if Earth’s atmosphere wasn’t photo-bombing it all the time. Even images obtained by the world’s best ground-based telescopes are blurry due to the atmosphere’s shifting pockets of air.
While seemingly harmless, this blur obscures the shapes of objects in astronomical images, sometimes leading to error-filled physical measurements that are essential for understanding the nature of our universe.
Now researchers at Northwestern University in the USA and Tsinghua University in Beijing have unveiled a new AI strategy to fix this issue.
The team adapted a well-known computer-vision algorithm used for sharpening photos and, for the first time, applied it to astronomical images from ground-based telescopes.
The researchers also trained the artificial intelligence (AI) algorithm on data simulated to match the Vera C Rubin Observatory’s imaging parameters, so, when the observatory opens next year, the tool will be instantly compatible.
See also: JWST images of nearby galaxies provide clues about star formation
Algorithm
While astrophysicists already use technologies to remove blur, the adapted AI-driven algorithm works faster and produces more realistic images than current technologies.
The resulting images are blur-free and truer to life. They are also beautiful — although that’s not the technology’s purpose.
Emma Alexander, an assistant professor of computer science at Northwestern’s McCormick School of Engineering, where she runs the Bio Inspired Vision Lab, is the study’s senior author. She said: “Photography’s goal is often to get a pretty, nice-looking image, but astronomical images are used for science.
“By cleaning up images in the right way, we can get more accurate data. The algorithm removes the atmosphere computationally, enabling physicists to obtain better scientific measurements.
“At the end of the day, the images do look better as well.”
When light emanates from distant stars, planets and galaxies, it travels through Earth’s atmosphere before it hits our eyes.
Not only does our atmosphere block out certain wavelengths of light, it also distorts the light that reaches Earth.
Even clear night skies still contain moving air that affects light passing through it. That’s why stars twinkle and why the best ground-based telescopes are located at high altitudes where the atmosphere is thinnest.
Alexander said: “It’s a bit like looking up from the bottom of a swimming pool – the water pushes light around and distorts it. The atmosphere is, of course, much less dense, but it’s a similar concept.”
Cosmological structures
The blur becomes an issue when astrophysicists analyse images to extract cosmological data.
By studying the apparent shapes of galaxies, scientists can detect the gravitational effects of large-scale cosmological structures, which bend light on its way to our planet.
This can cause an elliptical galaxy to appear rounder or more stretched than it really is. But atmospheric blur smears the image in a way that warps the galaxy shape.
Removing the blur enables scientists to collect accurate shape data.
Alexander said: “Slight differences in shape can tell us about gravity in the universe.
“These differences are already difficult to detect. If you look at an image from a ground-based telescope, a shape might be warped. It’s hard to know if that’s because of a gravitational effect or the atmosphere.”
To tackle this challenge, Alexander and Tianao Li, an undergraduate in electrical engineering at Tsinghua University and a research intern in Alexander’s lab, combined an optimisation algorithm with a deep-learning network trained on astronomical images.
Among the training images, the team included simulated data that matches the Rubin Observatory’s expected imaging parameters.
The resulting tool produced images with 38.6% less error compared to classic methods for removing blur and 7.4% less error compared to modern methods.
When the Rubin Observatory officially opens next year, its telescopes will begin a decade-long deep survey across an enormous portion of the night sky.
Because the researchers trained the new tool on data specifically designed to simulate Rubin’s upcoming images, it will be able to help analyse the survey’s highly anticipated data.
Alexander said: “Now we pass off this tool, putting it into the hands of astronomy experts. We think this could be a valuable resource for sky surveys to obtain the most realistic data possible.”
The study, Galaxy image deconvolution for weak gravitational lensing with unrolled plug-and-play ADMM, used computational resources from the Computational Photography Lab at Northwestern University.
The research is published in the Monthly Notices of the Royal Astronomical Society.
Image 1: Researchers used the AI algorithm to remove the simulated atmospheric blur, revealing the true-to-life image.
Image 2: A simulated image to match the parameters of the Vera C Rubin Observatory’s Legacy Survey of Space and Time (LSST). To simulate the image, researchers took high-resolution, atmosphere-free images from the Hubble Space Telescope (in the COSMOS dataset), simulated the atmospheric effects using a software package called GalSim with LSST parameters plugged in, and then downsampled to the lower resolution of the LSST.
Both images: © Emma Alexander/ Northwestern University.
