Affiliation:
1. Department of Mechanical Engineering University College London London WC1E 7JE UK
2. Department of Physics and Astronomy University College London London WC1E 6BT UK
3. School of Pharmacy University College London London WC1N 1AX UK
Abstract
Machine learning (ML) has been harnessed as a promising modelling tool for materials research. However, small data, or data scarcity, is a bottleneck when incorporating ML in studies involving experimentation. Current experiment planning methods show several disadvantages: one‐factor‐at‐a‐time (OFAT) experimentation became impractical due to limited laboratory resources; conventional design of experiments (DoE) failed to incorporate high‐dimensional features in ML; Surrogate‐based or Bayesian optimization (BO) shifted the goal to optimize material properties rather than guiding training data accumulation. The present research proposes leveraging active learning (AL) to strategically select critical data for experimentation. Two AL strategies, query‐by‐Committee (QBC) algorithm and Greedy method, are benchmarked against random query baseline on various materials datasets. AL is shown to efficiently reduce model prediction errors with minimal additional experiment data. Investigation of hyperparameters revealed benefits of applying AL at an early stage of experimental dataset construction. Moreover, AL is implemented and validated for an in‐house materials development task ‐ electrospray modelling. AL exploration as a paradigm is highlighted to guide experiment design for efficient data accumulation purposes, and its potential for further ML modelling. In doing so, the power of ML is expected to be fully unleashed to experimental researchers.
Funder
Engineering and Physical Sciences Research Council
Reference69 articles.
1. A.Dosovitskiy L.Beyer A.Kolesnikov D.Weissenborn X.Zhai T.Unterthiner M.Dehghani M.Minderer G.Heigold S.Gelly J.Uszkoreit N.Houlsby inInt. Conf. on Learning Representations online May2021.
2. T.Brown B.Mann N.Ryder M.Subbiah J. D.Kaplan P.Dhariwal A.Neelakantan P.Shyam G.Sastry A.Askell S.Agarwal A.Herbert‐Voss G.Krueger T.Henighan R.Child A.Ramesh D.Ziegler J.Wu C.Winter C.Hesse M.Chen E.Sigler M.Litwin S.Gray B.Chess J.Clark C.Berner S.McCandlish A.Radford I.Sutskever D.Amodeiet al. inAdvances on Neural Information Processing Systems Vancouver Canada December2020 pp.1877–1901.
3. Machine Learning‐Driven Biomaterials Evolution
4. Machine learning for molecular and materials science
5. Applications of machine learning in drug discovery and development