journal article Aug 04, 2010

Application of support vector regression for developing soft sensors for nonlinear processes

View at Publisher Save 10.1002/cjce.20363
Abstract
AbstractThe field of soft sensor development has gained significant importance in the recent past with the development of efficient and easily employable computational tools for this purpose. The basic idea is to convert the information contained in the input–output data collected from the process into a mathematical model. Such a mathematical model can be used as a cost efficient substitute for hardware sensors. The Support Vector Regression (SVR) tool is one such computational tool that has recently received much attention in the system identification literature, especially because of its successes in building nonlinear blackbox models. The main feature of the algorithm is the use of a nonlinear kernel transformation to map the input variables into a feature space so that their relationship with the output variable becomes linear in the transformed space. This method has excellent generalisation capabilities to high‐dimensional nonlinear problems due to the use of functions such as the radial basis functions which have good approximation capabilities as kernels. Another attractive feature of the method is its convex optimization formulation which eradicates the problem of local minima while identifying the nonlinear models. In this work, we demonstrate the application of SVR as an efficient and easy‐to‐use tool for developing soft sensors for nonlinear processes. In an industrial case study, we illustrate the development of a steady‐state Melt Index soft sensor for an industrial scale ethylene vinyl acetate (EVA) polymer extrusion process using SVR. The SVR‐based soft sensor, valid over a wide range of melt indices, outperformed the existing nonlinear least‐square‐based soft sensor in terms of lower prediction errors. In the remaining two other case studies, we demonstrate the application of SVR for developing soft sensors in the form of dynamic models for two nonlinear processes: a simulated pH neutralisation process and a laboratory scale twin screw polymer extrusion process. A heuristic procedure is proposed for developing a dynamic nonlinear‐ARX model‐based soft sensor using SVR, in which the optimal delay and orders are automatically arrived at using the input–output data.
Topics

No keywords indexed for this article. Browse by subject →

References
42
[1]
Alleyne I. R. “Optimal Grade Transition Policies for a High Pressure EVA Polymerization Plant ” Ph.D. Thesis University of Alberta (2006).
[3]
An Introduction To Compressive Sampling

E.J. Candes, M.B. Wakin

IEEE Signal Processing Magazine 10.1109/msp.2007.914731
[4]
Chang C.‐C.andC.‐J.Lin “LIBSVM: A Library for Support Vector Machines ” Software available athttp://www.csie.ntu.edu.tw/∼cjlin/libsvm(2001).
[6]
De Moor B. L. R. “DaISy: Database for the Identification of Systems ” Department of Electrical Engineering ESAT/SISTA K.U. Leuven Belgium.http://homes.esat.kuleuven.be/∼smc/daisy/[used data set: pH Data Section: Process Industry Systems code number: 96‐014] (2010).
[7]
Drucker H. C.Burges L.Kaufman A.SmolaandV.Vapnik “Support Vector Regression Machines ” Proceedings of the 1996 Conference on Advances in Neural Information Processing Systems 9 155–161 MIT Press Cambridge MA (1997).
[10]
Hsu C.‐W. C.‐C.ChangandC.‐J.Lin “A Practical Guide to Support Vector Classification ” Technical Report Department of Computer Science and Information Engineering National Taiwan University. Available athttp://www.csie.ntu.edu.tw/∼cjlin/papers/guide/guide.pdf(2004).
[11]
Robust Estimation of a Location Parameter

Peter J. Huber

The Annals of Mathematical Statistics 10.1214/aoms/1177703732
[13]
Janssen L. P. B. M. (1977)
[15]
Li H. X.ZhuandB.Shi “Nonlinear Identification Based on Least Squares Support Vector Machine ” Control Automation Robotics and Vision Conference 2004 ICARCV 2004 8th Vol. 3 2331–2335 (2004). 10.1109/icarcv.2004.1469796
[17]
Ljung L. “Identification of Nonlinear Systems ” 9th International Conference of IEEE on Control Automation Robotics and Vision (ICARCV 2006) (2006).
[18]
Ljung L. Q.Zhang P.Lindskog A.JuditskyandR.Singh “An Integrated System Identification Toolbox for Linear and Non‐Linear Models ” Proc. 14th IFAC Symposium on System Identification Newcastle Australia (2006). 10.3182/20060329-3-au-2901.00148
[25]
Platt J. C. (1999)
[26]
Pontil M. S.MukherjeeandF.Girosi “On the Noise Model of Support Vector Machines Regression ” Algorithmic Learning Theory 11th International Conference ALT 2000 Sydney Australia December 2000 Proceedings Vol. 1968 pp. 316–324 Springer Springer‐Verlag Berlin (2000). 10.1007/3-540-40992-0_24
[29]
Saunders G. A.GammermanandV.Vovk “Ridge Regression Learning Algorithm in Dual Variables ” Proc. 15th International Conf. on Machine Learning Morgan Kaufmann San Francisco CA pp. 515–521 (1998).
[33]
Smola A. J.andB.Scholkopf “A Tutorial on Support Vector Regression ” Technical Report NC2‐TR‐1998‐030 NeuroCOLT2 ESPRIT Working Group on Neural and Computational Learning Theory Royal Holloway College University of London (2003).
[34]
Suykens J. A. K. “Support Vector Machines and Kernel‐Based Learning for Dynamical Systems Modelling ” Proceedings of the 15th IFAC Symposium on System Identification Saint‐Malo France pp. 1029–1037 (2009). 10.3182/20090706-3-fr-2004.00171
[35]
Least Squares Support Vector Machine Classifiers

J.A.K. Suykens, J. Vandewalle

Neural Processing Letters 10.1023/a:1018628609742
[36]
Vapnik V. N. (1998)
[37]
Vapnik V. N. (1974)
[38]
Vogt M. K.SpreitzerandV.Kecman “Identification of a High Efficiency Boiler by Support Vector Machines Without Bias Term ” System Identification 2003: A Proceedings Volume from the 13th IFAC Symposium on System Identification Rotterdam The Netherlands August 27–29 2003 1 465–471 (2004).
[40]
Weston J. (1999)
[41]
Support vector regression model predictive control on a HVAC plant

Xue-Cheng Xi, Aun-Neow Poo, Siaw-Kiang Chou

Control Engineering Practice 10.1016/j.conengprac.2006.10.010
Metrics
45
Citations
42
References
Details
Published
Aug 04, 2010
Vol/Issue
88(5)
Pages
696-709
License
View
Cite This Article
Saneej B. Chitralekha, Sirish L. Shah (2010). Application of support vector regression for developing soft sensors for nonlinear processes. The Canadian Journal of Chemical Engineering, 88(5), 696-709. https://doi.org/10.1002/cjce.20363