journal article Nov 08, 2021

A transfer learning approach for predictive modeling of bioprocesses using small data

Biotechnology and Bioengineering Vol. 119 No. 2 pp. 411-422 · Wiley
View at Publisher Save 10.1002/bit.27980
Abstract
AbstractPredictive modeling of new biochemical systems with small data is a great challenge. To fill this gap, transfer learning, a subdomain of machine learning that serves to transfer knowledge from a generalized model to a more domain‐specific model, provides a promising solution. While transfer learning has been used in natural language processing, image analysis, and chemical engineering fault detection, its application within biochemical engineering has not been systematically explored. In this study, we demonstrated the benefits of transfer learning when applied to predict dynamic behaviors of new biochemical processes. Two different case studies were presented to investigate the accuracy, reliability, and advantage of this innovative modeling approach. We thoroughly discussed the different transfer learning strategies and the effects of topology on transfer learning, comparing the performance of the transfer learning models against benchmark kinetic and data‐driven models. Furthermore, strong connections between the underlying process mechanism and the transfer learning model's optimal structure were highlighted, suggesting the interpretability of transfer learning to enable more accurate prediction than a naive data‐driven modeling approach. Therefore, this study shows a novel approach to effectively combining data from different resources for bioprocess simulation.
Topics

No keywords indexed for this article. Browse by subject →

References
33
[16]
Montavon G. Binder A. Lapuschkin S. Samek W.&Müller K. R.(2019). Layer-wise relevance propagation: An overview. In: Samek W. Montavon G. Vedaldi A. Hansen L. & Müller K. R. (eds.) Explainable AI: Interpreting explaining and visualizing deep learning. Lecture notes in computer science(Vol. 11700). Cham: Springer.https://doi.org/10.1007/978-3-030-28954-6_10 10.1007/978-3-030-28954-6_10
[18]
A Survey on Transfer Learning

Sinno Jialin Pan, Qiang Yang

IEEE Transactions on Knowledge and Data Engineerin... 10.1109/tkde.2009.191
[20]
Quattoni A. Collins M.&Darrell T.(2008). Transfer learning for image classification with sparse prototype representations. 2008 IEEE Conference on Computer Vision and Pattern Recognition 1–8.https://doi.org/10.1109/CVPR.2008.4587637 10.1109/cvpr.2008.4587637
[21]
Rahman M.(2020).Bioprocess simulation and optimisation using machine learning(Master's thesis). The University of Manchester.
[24]
Improved protein structure prediction using potentials from deep learning

Andrew W. Senior, Richard Evans, John Jumper et al.

Nature 10.1038/s41586-019-1923-7
[25]
Shaha M.&Pawar M.(2018). Transfer Learning for Image Classification. 2018 Second International Conference on Electronics Communication and Aerospace Technology (ICECA) 656–660.https://doi.org/10.1109/ICECA.2018.8474802 10.1109/iceca.2018.8474802
[28]
Wang D.&Zheng T. F.(2015). Transfer learning for speech and language processing. 2015 Asia‐Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA) 1225–1237.https://doi.org/10.1109/APSIPA.2015.7415532 10.1109/apsipa.2015.7415532
Cited By
49
Wheels turning: CHO cell modeling moves into a digital biomanufacturing era

Sandeep Ranpura, Vishwanathgouda Maralingannavar · 2025

Computational and Structural Biotec...
BioDesign Research
Metrics
49
Citations
33
References
Details
Published
Nov 08, 2021
Vol/Issue
119(2)
Pages
411-422
License
View
Funding
National Natural Science Foundation of China Award: 21776232
Engineering and Physical Sciences Research Council Award: EP/T031123/1
Cite This Article
Alexander W. Rogers, Fernando Vega‐Ramon, Jiangtao Yan, et al. (2021). A transfer learning approach for predictive modeling of bioprocesses using small data. Biotechnology and Bioengineering, 119(2), 411-422. https://doi.org/10.1002/bit.27980
Related

You May Also Like

Diffusion characteristics of substrates in Ca‐alginate gel beads

Hideo Tanaka, Masatoshi Matsumura · 1984

583 citations

Fractionating recalcitrant lignocellulose at modest reaction conditions

Yi‐Heng Percival Zhang, Shi‐You Ding · 2007

477 citations

Estimation of diffusion coefficients of proteins

M. E. Young, P. A. Carroad · 1980

475 citations

Dynamic modeling of the central carbon metabolism of Escherichia coli

Christophe Chassagnole, Naruemol Noisommit‐Rizzi · 2002

470 citations