Abstract
Locally weighted partial least square (LW-PLS) model has been commonly used to develop adaptive soft sensors and process monitoring for numerous industries which include pharmaceutical, petrochemical, semiconductor, wastewater treatment system and biochemical. The advantages of LW-PLS model are its ability to deal with a large number of input variables, collinearity among the variables and outliers. Nevertheless, since most industrial processes are highly nonlinear, a traditional LW-PLS which is based on a linear model becomes incapable of handling nonlinear processes. Hence, an improved LW-PLS model is required to enhance the adaptive soft sensors in dealing with data nonlinearity. In this work, Kernel function which has nonlinear features was incorporated into LW-PLS model and this proposed model is named locally weighted kernel partial least square (LW-KPLS). Comparisons between LW-PLS and LW-KPLS models in terms of predictive performance and their computational loads were carried out by evaluating both models using data generated from a simulated plant. From the results, it is apparent that in terms of predictive performance LW-KPLS is superior compared to LW-PLS. However, it is found that computational load of LW-KPLS is higher than LW-PLS. After adapting ensemble method with LW-KPLS, computational loads of both models were found to be comparable. These indicate that LW-KPLS performs better than LW-PLS in nonlinear process applications. In addition, evaluation on localization parameter in both LW-PLS and LW-KPLS is also carried out.
Funding statement: This research is co-funded by Fundamental Research Grant Scheme (FRGS/2/2014/TK05/CURTIN/02/1), Ministry of Education, Malaysia and Curtin University Malaysia under Staff Study Support.
References
[1] Kano M, Ogawa M. The state of the art in chemical process control in Japan: good practice and questionnaire survey. J Process Control. 2010;20:969–982.10.1016/j.jprocont.2010.06.013Search in Google Scholar
[2] Kano M, Koichi F. Virtual sensing technology in process industries: trends and challenges revealed by recent industrial applications. J Chem Eng Japan. 2013;46:1–17.10.1252/jcej.12we167Search in Google Scholar
[3] Jin H, Chen X, Yang J, Wu L. Adaptive soft sensor modeling framework based on just-in-time learning and kernel partial least squares regression for nonlinear multiphase batch processes. Comput Chem Eng. 2014;71:77–93.10.1016/j.compchemeng.2014.07.014Search in Google Scholar
[4] Kim S, Kano M, Hasebe S, Takinami A, Seki T. Long-term industrial applications of inferential control based on just-in-time soft-sensors: economical impact and challenges. Ind Eng Chem Res. 2013;52:12346–12356.10.1021/ie303488mSearch in Google Scholar
[5] Kim S, Okajima R, Kano M, Hasebe S. Development of soft-sensor using locally weighted PLS with adaptive similarity measure. Chemom Intell Lab Syst. 2013;124:43–49.10.1016/j.chemolab.2013.03.008Search in Google Scholar
[6] Hazama K, Kano M. Covariance-based locally weighted partial least squares for high-performance adaptive modeling. Chemom Intell Lab Syst. 2015;146:55–62.10.1016/j.chemolab.2015.05.007Search in Google Scholar
[7] Saptoro A.. State of the art in the development of adaptive soft sensors based on just-in-time models. Procedia Chemistry Elsevier), 2014;226–234.10.1016/j.proche.2014.05.027Search in Google Scholar
[8] Kadlec P, Grbić R, Gabrys B. Review of adaptation mechanisms for data-driven soft sensors. Comput Chem Eng. 2011;35:1–24.10.1016/j.compchemeng.2010.07.034Search in Google Scholar
[9] Jin H, Chen X, Yang J, Wang L, Wu L. Online local learning based adaptive soft sensor and its application to an industrial fed-batch chlortetracycline fermentation process. Chemom Intell Lab Syst. 2015;143:58–78.10.1016/j.chemolab.2015.02.018Search in Google Scholar
[10] Jin H, Chen X, Yang J, Zhang H, Wang L, Wu L. Multi-model adaptive soft sensor modeling method using local learning and online support vector regression for nonlinear time-variant batch processes. Chem Eng Sci. 2015;131:282–303.10.1016/j.ces.2015.03.038Search in Google Scholar
[11] Kaneko H, Funatsu K. Adaptive database management based on the database monitoring index for long-term use of adaptive soft sensors. Chemom Intell Lab Syst. 2015;146:179–185.10.1016/j.chemolab.2015.05.024Search in Google Scholar
[12] Gao Y, Kong X, Hu C, Zhang Z, Li H, Hou LA. Multivariate data modeling using modified kernel partial least squares. Chem Eng Res Des. 2015;94:466–474.10.1016/j.cherd.2014.09.004Search in Google Scholar
[13] Shan P, Peng S, Tang L, Yang C, Zhao Y, Xie Q, et al. A nonlinear partial least squares with slice transform based piecewise linear inner relation. Chemom Intell Lab Syst. 2015;143:97–110.10.1016/j.chemolab.2015.02.015Search in Google Scholar
[14] Hu Y, Ma H, Shi H. Enhanced batch process monitoring using just-in-time-learning based kernel partial least squares. Chemom Intell Lab Syst. 2013;123:15–27.10.1016/j.chemolab.2013.02.004Search in Google Scholar
[15] Wang L, Yang D, Fang C, Chen Z, Lesniewski PJ, Mallavarapu M, et al. Application of neural networks with novel independent component analysis methodologies to a Prussian blue modified glassy carbon electrode array. Talanta. 2015;131:395–403.10.1016/j.talanta.2014.08.010Search in Google Scholar PubMed
[16] Rosipal R. Chemoinformatics and advanced machine learning perspectives: complex computational methods and collaborative techniques In: Lodhi H, Yamanishi Y, editors. Nonlinear partial least squares: an overview. Hershey, PA: IGI Global, 2010: 169-189.10.4018/978-1-61520-911-8.ch009Search in Google Scholar
[17] Frank IE. A nonlinear PLS model. Chemom Intell Lab Syst. 1990;8:109–119.10.1016/0169-7439(90)80128-SSearch in Google Scholar
[18] Wang Y, Cao H, Zhou Y, Zhang Y. Nonlinear partial least squares regressions for spectral quantitative analysis. Chemom Intell Lab Syst. 2015;148:32–50.10.1016/j.chemolab.2015.08.024Search in Google Scholar
[19] Shan P, Peng S, Bi Y, Tang L, Yang C, Xie Q, et al. Partial least squares–slice transform hybrid model for nonlinear calibration. Chemom Intell Lab Syst. 2014;138:72–83.10.1016/j.chemolab.2014.07.015Search in Google Scholar
[20] Zhou YP, Jiang JH, Lin WQ, Xu L, Wu HL, Shen GL, et al. Artificial neural network-based transformation for nonlinear partial least-square regression with application to QSAR studies. Talanta. 2007;71:848–853.10.1016/j.talanta.2006.05.058Search in Google Scholar PubMed
[21] Wold S. Nonlinear partial least squares modelling II. Spline inner relation. Chemom Intell Lab Syst. 1992;14:71–84.10.1016/0169-7439(92)80093-JSearch in Google Scholar
[22] Rosipal R, Trejo LJ. Kernel partial least squares regression in reproducing kernel hilbert space. J Machine Learn Res. 2002;2:97–123.Search in Google Scholar
[23] Zhang Y, Zhang Y. Complex process monitoring using modified partial least squares method of independent component regression. Chemom Intell Lab Syst. 2009;98:143–148.10.1016/j.chemolab.2009.06.001Search in Google Scholar
[24] Hu Y, Wang L, Ma H, Shi H. Online nonlinear process monitoring using kernel partial least squares [J]. Ciesc J. 2011;9:025.Search in Google Scholar
[25] Zhang Y, Li S, Hu Z, Song C. Dynamical process monitoring using dynamical hierarchical kernel partial least squares. Chemom Intell Lab Syst. 2012;118:150–158.10.1016/j.chemolab.2012.07.004Search in Google Scholar
[26] Zhang Y, Hu Z. On-line batch process monitoring using hierarchical kernel partial least squares. Chem Eng Res Des. 2011;89:2078–2084.10.1016/j.cherd.2011.01.002Search in Google Scholar
[27] Jia Q, Zhang Y. Quality-related fault detection approach based on dynamic kernel partial least squares. Chem Eng Res Des. 2016;106:242–252.10.1016/j.cherd.2015.12.015Search in Google Scholar
[28] Zhang Y, Teng Y, Zhang Y. Complex process quality prediction using modified kernel partial least squares. Chem Eng Sci. 2010;65:2153–2158.10.1016/j.ces.2009.12.010Search in Google Scholar
[29] García-Reiriz A, Damiani PC, Olivieri AC. Residual bilinearization combined with kernel-unfolded partial least-squares: a new technique for processing non-linear second-order data achieving the second-order advantage. Chemom Intell Lab Syst. 2010;100:127–135.10.1016/j.chemolab.2009.11.009Search in Google Scholar
[30] Yuan X, Ge Z, Song Z. Locally weighted kernel principal component regression model for soft sensing of nonlinear time-variant processes. Ind Eng Chem Res. 2014;53:13736–13749.10.1021/ie4041252Search in Google Scholar
[31] Jiang Q, Yan X. Weighted kernel principal component analysis based on probability density estimation and moving window and its application in nonlinear chemical process monitoring. Chemom Intell Lab Syst. 2013;127:121–131.10.1016/j.chemolab.2013.06.013Search in Google Scholar
[32] Toshiya H, Kano M. Adaptive virtual metrology design for semiconductor dry etching process through locally weighted partial least squares. IEEE Trans Semicond Manuf. 2015;28:137–144.10.1109/TSM.2015.2409299Search in Google Scholar
[33] Nakagawa H, Tajima T, Kano M, Kim S, Hasebe S, Suzuki T, et al. Evaluation of infrared-reflection absorption spectroscopy measurement and locally weighted partial least-squares for rapid analysis of residual drug substances in cleaning processes. Anal Chem. 2012;84:3820–3826.10.1021/ac202443aSearch in Google Scholar PubMed
[34] Kim S, Kano M, Nakagawa H, Hasebe S. Estimation of active pharmaceutical ingredients content using locally weighted partial least squares and statistical wavelength selection. Int J Pharm. 2011;421:269–274.10.1016/j.ijpharm.2011.10.007Search in Google Scholar PubMed
[35] Nakagawa H, Kano M, Hasebe S, Miyano T, Watanabe T, Wakiyama N. Verification of model development technique for NIR-based real-time monitoring of ingredient concentration during blending. Int J Pharm. 2014;471:264–275.10.1016/j.ijpharm.2014.05.013Search in Google Scholar PubMed
[36] Schölkopf B, Smola A, Müller KR. Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput. 1998;10:1299–1319.10.1162/089976698300017467Search in Google Scholar
[37] Zhang X, Li Y, Kano M. Quality prediction in complex batch processes with just-in-time learning model based on non-gaussian dissimilarity measure. Ind Eng Chem Res. 2015;54:7694–7705.10.1021/acs.iecr.5b01425Search in Google Scholar
[38] Xie L, Zeng J, Gao C. Novel just-in-time learning-based soft sensor utilizing non-Gaussian information. IEEE Trans Control Syst Technol. 2014;22:360–368.10.1109/TCST.2013.2248155Search in Google Scholar
[39] Ma M, Khatibisepehr S, Huang B. A Bayesian framework for real‐time identification of locally weighted partial least squares. AIChE J. 2015;61:518–529.10.1002/aic.14663Search in Google Scholar
[40] Shawe-Taylor J, Cristianini N. Kernel methods for pattern analysis. New York, USA: Cambridge University Press, 2004.10.1017/CBO9780511809682Search in Google Scholar
[41] Dou Y, Sun Y, Ren Y, Ren Y. Artificial neural network for simultaneous determination of two components of compound paracetamol and diphenhydramine hydrochloride powder on NIR spectroscopy. Anal Chim Acta. 2005;528:55–61.10.1016/j.aca.2004.10.050Search in Google Scholar
[42] Saptoro A, Hari BV, Moses OT.. Design of feed-forward neural networks architecture for coal elemental composition prediction. International conference on modeling and simulation, Kuala Lumpur, Malaysia; 2006;3–5.Search in Google Scholar
[43] Novak B, Tyson JJ. Modeling the cell division cycle: M-phase trigger, oscillations, and size control. J Theor Biol. 1993;165:101–134.10.1006/jtbi.1993.1179Search in Google Scholar
© 2017 Walter de Gruyter GmbH, Berlin/Boston
Articles in the same Issue
- Editorial
- Editorial: Special Issue of 29th Symposium of Malaysian Chemical Engineers (SOMChE) 2016 – Process System Engineering
- Research Articles
- Effect of Inventory Change in a Liquid – Solid Circulating Fluidized Bed (LSCFB)
- Simulation and Optimization of the Utilization of Triethylene Glycol in a Natural Gas Dehydration Process
- Development of Adaptive Soft Sensor Using Locally Weighted Kernel Partial Least Square Model
- Comparison of Turbulence Models for Single Sphere Simulation Study Under Supercritical Fluid Condition
- Integrated Palm Biomass Supply Chain toward Sustainable Management
- Multi-Scale Control of Bunsen Section in Iodine-Sulphur Thermochemical Cycle Process
- Optimisation of Design and Operation Parameters for Multicomponent Separation via Improved Lewis-Matheson Method
- The Effect of Various Components of Triglycerides and Conversion Factor on Energy Consumption in Biodiesel Production
- CFD Simulation on the Hydrodynamics in Gas-Liquid Airlift Reactor
- Analysis of the Steady-State Multiplicity Behavior for Polystyrene Production in the CSTR
- Numerical Studies on the Laminar Thermal-Hydraulic Efficiency of Water-Based Al2O3 Nanofluid in Circular and Non-Circular Ducts
- Simultaneous Carbon Capture and Reuse Using Catalytic Membrane Reactor in Water-Gas Shift Reaction
Articles in the same Issue
- Editorial
- Editorial: Special Issue of 29th Symposium of Malaysian Chemical Engineers (SOMChE) 2016 – Process System Engineering
- Research Articles
- Effect of Inventory Change in a Liquid – Solid Circulating Fluidized Bed (LSCFB)
- Simulation and Optimization of the Utilization of Triethylene Glycol in a Natural Gas Dehydration Process
- Development of Adaptive Soft Sensor Using Locally Weighted Kernel Partial Least Square Model
- Comparison of Turbulence Models for Single Sphere Simulation Study Under Supercritical Fluid Condition
- Integrated Palm Biomass Supply Chain toward Sustainable Management
- Multi-Scale Control of Bunsen Section in Iodine-Sulphur Thermochemical Cycle Process
- Optimisation of Design and Operation Parameters for Multicomponent Separation via Improved Lewis-Matheson Method
- The Effect of Various Components of Triglycerides and Conversion Factor on Energy Consumption in Biodiesel Production
- CFD Simulation on the Hydrodynamics in Gas-Liquid Airlift Reactor
- Analysis of the Steady-State Multiplicity Behavior for Polystyrene Production in the CSTR
- Numerical Studies on the Laminar Thermal-Hydraulic Efficiency of Water-Based Al2O3 Nanofluid in Circular and Non-Circular Ducts
- Simultaneous Carbon Capture and Reuse Using Catalytic Membrane Reactor in Water-Gas Shift Reaction