Monday, January 22, 2024

Vera Rubin Will Help Us Find the Weird and Wonderful Things Happening in the Solar System

The Vera Rubin Observatory (VRO) is something special among telescopes. It’s not built for better angular resolution and increased resolving power like the European Extremely Large Telescope or the Giant Magellan Telescope. It’s built around a massive digital camera and will repeatedly capture broad, deep views of the entire sky rather than focus on any individual objects.

By repeatedly surveying the sky, the VRO will spot any changes or astronomical transients. Astronomers call this type of observation Time Domain Astronomy.

When the VRO spots something transient in the night sky, it’ll automatically send alerts out to other observatories that will observe the transient object in detail. It could be a distant supernova explosion, a hazardous asteroid here in the inner Solar System, or anything that registers a change in the sky. The VRO’s job is to spot it and then pass the baton to other observatories.

But issuing alerts to other telescopes is just one of the things the VRO will do. The VRO’s primary observing program is called the Legacy Survey of Space and Time (LSST.) The LSST will catalogue the entire available night sky by imaging it every night for ten years with its massive 3.2 gigapixel camera. Every five seconds, the camera will point to a different part of the sky and capture a 15-second exposure.

This decade-long effort will generate an enormous amount of data. It’ll take 200,000 images per year, amounting to 1.28 petabytes of data. There’ll be so much data that the VRO project includes a new data pipeline travelling from its site in northern Chile back to the US. There’s no way that people can process all the data, so machine learning will play a big role in handling it and finding what’s hidden.

The authors of a new research paper developed a novel way for the observatory to detect anomalies in the immense amount of data it generates. The paper is “The Weird and the Wonderful in our Solar System: Searching for Serendipity in the Legacy Survey of Space and Time.” It’s been accepted for publication in The Astronomical Journal, and the lead author is Brian Rogers from the Department of Physics at the University of Oxford.

The list of objects and events the VRO will spot contains all the things we’d expect to see. Along with supernovae and asteroids, the VRO might spot the elusive Planet 9 that may be lurking in the far reaches of our Solar System. It’ll also see kilonovae, gamma-ray bursts, variable quasars, AGN, and even interstellar objects (ISOs) like Oumaumua and Borisov.

But to find those objects in all that data requires machine learning. The authors have developed a type of neural network to process the data. A neural network is a type of AI that mimics how the human brain works. It employs a layered network of individual nodes, or neurons, that somewhat resembles the human brain.

In simple terms, Neural Networks are a subset of Machine Learning, which is a subset of Artificial Intelligence. Without these tools, astronomers would have no hope of processing all of the data the VRO will generate. Image Credit: Evan Gough
In simple terms, Neural Networks are a subset of Machine Learning, which is a subset of Artificial Intelligence. Without these tools, astronomers would have no hope of processing all of the data the VRO will generate. Image Credit: Evan Gough

The authors have developed a specific type of neural network called an autoencoder. Autoencoders can perform a very useful function. They take data, encode or compress it, then reconstitute the data back into a version of itself. By doing that, an autoencoder can ‘learn’ which aspects of data are relevant and which are noise. The noise can then be discarded.

In their paper, the researchers write, “We present a novel method for anomaly detection in Solar System object data, in preparation for the Legacy Survey of Space and Time. We train a deep autoencoder for anomaly detection and use the learned latent space to search for other interesting objects.”

This simple schematic illustrates the general architecture of an autoencoder. It takes input, encodes it into a latent representation of the input, then decodes it and outputs it. Image Credit: Rogers et al. 2024
This simple schematic illustrates the general architecture of an autoencoder. It takes input, encodes it into a latent representation of the input, then decodes it and outputs it. Image Credit: Rogers et al. 2024

The authors’ autoencoder is based on finding anomalies like interstellar objects (ISOs.) If the autoencoder can identify them, it means that the massive amount of LSST data becomes more manageable. “We demonstrate the efficacy of the autoencoder approach by finding interesting examples, such as interstellar objects, and show that using the autoencoder, further examples of interesting classes can be found,” they explain.

They tested their autoencoder on a simulation of the 10 years of data the LSST will collect. As real data from the LSST arrives, they intend to keep testing their autoencoder and strengthening it. “In the meantime, this work does not attempt to quantify the likely yield of unusual objects but merely demonstrates that we can find them in a large survey of the type which will be produced by LSST,” they write.

What the authors call ‘reconstruction loss’ plays a large role in the work, as do anomalies.

When working with known, simulated data, the researchers measured the autoencoder’s accuracy. They simply measured the output against the input. Reconstruction loss is a measure of how accurate the autoencoder is and it can be quantified.

This figure from the research shows how the autoencoder can measure reconstruction loss in its latent space. It shows reconstruction scores for 3.1 million Solar System objects across the reduced feature space. Blue dots, which are tiny, represent objects with low reconstruction loss. Anomalous objects are shown with enlarged dots of redder colours. "The top 0.01% anomalies are enlarged for this plot. They lie distant from the majority of normal objects in blue," the authors write. Image Credit: Rogers et al. 2024.
This figure from the research shows how the autoencoder can measure reconstruction loss in its latent space. It shows reconstruction scores for 3.1 million Solar System objects across the reduced feature space. Blue dots, which are tiny, represent objects with low reconstruction loss. Anomalous objects are shown with enlarged dots of redder colours. “The top 0.01% anomalies are enlarged for this plot. They
lie distant from the majority of normal objects in blue,” the authors write. Image Credit: Rogers et al. 2024.

Anomalies are unusual objects that stand out, just as an ISO would. From the figure above, the authors identified the top ten anomalies ranked by reconstruction loss. For each of those ten, they identified their twenty nearest neighbours. These are not neighbours in the Solar System; they’re neighbours in the latent space.

The neighbourhoods of objects are related by aspects of data. They’re data neighbourhoods. For example, one of the neighbourhoods is based on measured magnitudes. Another is based on orbital eccentricity, and another is based on outlier objects in Jupiter’s vicinity.

Each of these panels is a different autoencoder output for the top ten anomalies and their data neighbours. The blue are normal objects, and the coloured dots show how the top ten anomalies relate to them. In this figure, ISOs are number 6, shown in red. The critical takeaway is that the anomalies are easily distinguished from normal objects and are grouped by certain characteristics like orbital eccentricity or magnitude. Image Credit: Rogers et al. 2024.
Each of these panels is a different autoencoder output for the top ten anomalies and their data neighbours. The blue are normal objects, and the coloured dots show how the top ten anomalies relate to them. In this figure, ISOs are number 6, shown in red. The critical takeaway is that the anomalies are easily distinguished from normal objects and are grouped by certain characteristics like orbital eccentricity or magnitude. Image Credit: Rogers et al. 2024.

Astronomy is changing. Our observatories and telescopes are becoming so powerful and automated that they create a massive universe of data. It’s beyond the capability of the astronomical community to deal with the data without automated help. By training the autoencoder to detect anomalies, it can sift through the LSST data and flag anomalies.

The authors are quick to point out that the autoencoder is not completely automatic. It still needs human help.

“After evaluating the deficiencies of standalone unsupervised methods, we demonstrated the power of human feedback in detecting anomalies <> using a supervised approach,” they write. “Using human feedback can increase the relevance, accuracy and precision of the anomaly detection system.”

It’s not hype to say that the Vera Rubin Observatory will change our understanding of our Solar System and things well beyond it. Its first light is scheduled for January 2025. It’ll take a while to test and commission all of the equipment, but sometime after that, the data will start to flow.

Once it does, there’ll be no stopping it, and astronomers will need tools like autoencoders to help them find anomalies.

“By putting the right anomalies in the right hands, we can multiply the value of the data collected by LSST and precipitate potential follow-up studies for the most interesting objects found in the survey,” the researchers write in their work. “We have demonstrated that deep autoencoders can fulfil this role as an unsupervised detection model by performing on the scale of LSST and that they can enable efficient anomaly discovery for the most interesting Solar System objects.”

The post Vera Rubin Will Help Us Find the Weird and Wonderful Things Happening in the Solar System appeared first on Universe Today.



No comments:

Post a Comment