AutoSciLab: A Self-Driving Laboratory For Interpretable Scientific Discovery

Saaketh Desai, Sadhvikas Addamane, Jeffrey Y. Tsao, Igal Brener, Laura P. Swiler, Remi Dingreville, Prasad P. Iyer · 2024

Read AutoSciLab: A Self-Driving Laboratory For Interpretable Scientific Discovery by Saaketh Desai, Sadhvikas Addamane, Jeffrey Y. Tsao, Igal Brener, Laura P. Swiler, Remi Dingreville, Prasad P. Iyer (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-12347.txt.

Introduction

Saaketh Desai and six colleagues wrote a paper in twenty twenty-four about AutoSciLab, a system that lets a robot lab run on its own. Robot labs can run tests fast and in large numbers. Yet picking what test to run next, in a space with many options, still rests on human hunches.

AutoSciLab plays the part of a stand-in researcher and works in four steps. It puts forward ideas, picks and runs tests, reads the results, and then starts again. Machine learning guides each pick, and the system shows its reasons in plain form rather than hiding them. It found anew the laws of projectile motion and of phase shifts in the Ising model. It also found a new way to steer loose light that beat the best known method.

Catalog record

CREATORSaaketh Desai, Sadhvikas Addamane, Jeffrey Y. Tsao, Igal Brener, Laura P. Swiler, Remi Dingreville, Prasad P. Iyer
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE71 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-12347

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

AutoSciLab: A Self-Driving Laboratory For Interpretable Scientific Discovery Saaketh Desai, Sadhvikas Addamane, Jeffrey Y. Tsao, Igal Brener, Laura P. Swiler, Remi Dingreville, Prasad P. Iyer Abstract Advances in robotic control and sensing have propelled the rise of automated scientific laboratories capable of high-throughput experiments. However, automated scientific laboratories are currently limited by human intuition in their ability to efficiently design and interpret experiments in high-dimensional spaces, throttling scientific discovery. We present AutoSciLab, a machine learning framework for driving autonomous scientific experiments, forming a surrogate researcher purposed for scientific discovery in high-dimensional spaces. AutoSciLab autonomously follows the scientific method in four steps: (i) generating high-dimensional experiments ( 𝐱 ∈ 𝐑 𝐃 \bf{x}\in R^{D} ) using a variational autoencoder (ii) selecting optimal experiments by forming hypotheses using active learning (iii) distilling the experimental results to discover relevant low-dimensional latent variables ( 𝐳 ∈ 𝐑 𝐝 \bf{z}\in R^{d} , with d ≪ D \text{d}\ll\text{D} ) with a ‘directional autoencoder’ and (iv) learning a human interpretable equation connecting the discovered latent variables with a quantity of interest ( y = f ⁡ ( z ) y=f(\textbf{z}) ), using a neural network equation learner. We validate the generalizability of AutoSciLab by rediscovering a) the principles of projectile motion and b) the phase-transitions within the spin-states of the Ising model (NP-hard problem). Applying our framework to an open-ended nanophotonics challenge, AutoSciLab uncovers a fundamentally novel method for directing incoherent light emission that surpasses the current state-of-the-art ( Iyer et al. 2023b ; Iyer et al. 2020 ) . 1 Center for Integrated Nanotechnologies, Sandia National Laboratories, Albuquerque, NM 2 Material, Physical and Chemical Sciences Center, Sandia National Laboratories, Albuquerque, NM 3 Center for Computing Research, Sandia National Laboratories, Center for Computing Research, Albuquerque, NM *[email protected] Introduction Scientific discoveries over the past centuries have been fueled in large parts by human intuition and ingenuity ( Koyré 2013 ) . The traditional scientific discovery process involves hypothesis generation, design of experiments to test hypotheses, and distillation of data into interpretable forms, such as equations. Scientists build upon these learnt equations, often extrapolating with their intuition to guide the next iteration of scientific discovery. However, a critical bottleneck in this scientific discovery process is the reliance on human intuition to generate a valid hypotheses, design experiments to test those hypotheses and interpret results in a large, high-dimensional design space. Within the physical sciences, the intuition bottleneck manifests as a lack of theoretical frameworks, requiring expensive experiments to traverse a high-dimensional space - i.e.,‘Blindly looking for a needle in a hay-stack with an expensive rake’. Machine learning (ML) methods have excelled at aiding researchers in identifying patterns and correlations within dense datasets, ( Krizhevsky, Sutskever, and Hinton 2012 ; Vaswani et al. 2017 ) , even in the physical sciences, ( Jumper et al. 2021 ; Choudhary et al. 2022 ) , demonstrating the ability to execute a few of the necessary steps leading up to interpretable scientific discovery, e.g., active learning (AL) for efficient design of experiments ( Ling et al. 2017 ; Kusne et al. 2020 ) , or deep neural networks to extract high-dimensional correlations in conducted experiments ( DeCost et al. 2019 ; Feng, Zhou, and Dong 2019 ) . However, a complete machine learning framework which realizes interpretable scientific discovery that can augment the human intuition remains an open challenge. Key impediments to the development of such a framework include the ability to design a large search space of candidate experiments significantly beyond current scientific understanding, efficiently discovering optimal candidates in this search space, and realizing interpretable results. Here, we present a solution titled AutoSciLab, which is a self-driving laboratory that employs machine learning methods to drive automated experiments. AutoSciLab accomplishes the following tasks: (a) Drives autonomous scientific experiments by hypothesizing the next experiment from a generated space of experiments, without the aid of human intuition (b) Minimizes the number of scientific experiments required to gain insight into the physical process while accounting for stochastic experiments (c) Distills the experiments to discover an informative latent space complimenting any prior knowledge (d) Learns an equation relating the discovered latent space with the physical property of interest Related Work Self-driving labs where automated experiments are driven by ML algorithms have recently gained popularity in the physical sciences ( Abolhasani and Kumacheva 2023 ; Seifrid et al. 2022 ; MacLeod et al. 2020 ) . While significant effort has focused on automating the ‘mechanical’ tasks of a physical science experiment (robotic sample handling, automated end-to-end multi-step experimental workflows) ( Abolhasani and Kumacheva 2023 ) , the ‘cognitive’ aspects (data analysis, designing optimal experiments) have largely explored optimization. Self-driving labs have so far not been used for interpretable scientific discovery, especially for understanding scientific principles in high-dimensional search spaces. We now breakdown each component of AutoSciLab, and compare it to prior work: Generating novel experiments: AutoSciLab employs generative models to generate novel experiments beyond human intuition. Generative models such as Variational Autoencoders (VAEs) ( Kingma and Welling 2013 ) and Generative Adversarial Networks ( Goodfellow et al. 2020 ) have shown excellent promise in generating structures in the physical sciences ( Kim et al. 2020 ; Anstine and Isayev 2023 ) . However, these models have yet to gain popularity within self-driving labs to generate novel experiments. Efficient design of experiments: Efficient design of experiments via Bayesian optimization or active learning, is a staple of current self-driving labs ( Ling et al. 2017 ; Kusne et al. 2020 ) . Other techniques such as differential evolution ( Storn and Price 1997 ) are also widely used for design of experiments ( Zhong et al. 2015 ; Kim et al. 2021 ) . However, these tools are often used with the intention of optimization and discovery, and not with the goal of interpretable scientific understanding. Interpreting experiments using machine learning: Explainable and interpretable machine learning techniques, such as physics-informed neural networks ( Raissi, Perdikaris, and Karniadakis 2019 ) , explainability metrics ( Lundberg and Lee 2017 ) , and equation learner models ( Desai and Strachan 2021 ; Sahoo, Lampert, and Martius 2018 ; Schmidt and Lipson 2009 ) have shown great promise in the physical sciences. However, these models have not been used in conjunction with self-driving labs and autonomous experiments. The AutoSciLab framework AutoSciLab drives autonomous scientific experiments to discover an interpretable relationship between a physical quantity of interest y\in R^{m} and high-dimensional inputs \bf{x}\in R^{D} , see Fig. 1 . AutoSciLab achieves this by recasting this problem as a discovery of an interpretable relationship between y\in R^{m} and low dimensional latent space variables \bf{z}\in R^{d} , with d\ll D . AutoSciLab then aims to learn y=f(\bf{z}) in a symbolic (equation) form. This recasting leverages the manifold hypothesis ( Narayanan and Mitter 2010 ; Fefferman, Mitter, and Narayanan 2016 ) , which states that high-dimensional data often resides in a low-dimensional manifold. The manifold hypotheses is often true in the physical sciences, where high-dimensional inputs often have specific, physics-driven mechanisms to affect a low-dimensional set of variables, which end up governing the quantity of interest y . To discover this relationship, AutoSciLab begins by reducing the high-dimensional inputs into a low-dimensional latent dimension \bf{z^{\prime}}\in R^{d} using a latent-space

Read the complete text