Abstract
Intelligent pattern recognition imposes new challenges in high-frequency financial data mining due to its irregularities and roughness. Based on the wavelet transform for decomposing systematic patterns and noise, in this paper we propose a new integrated wavelet denoising method, named smoothness-oriented wavelet denoising algorithm (SOWDA), that optimally determines the wavelet function, maximal level of decomposition, and the threshold rule by using a smoothness score function that simultaneously detects the global and local extrema. We discuss the properties of our method and propose a new evaluation procedure to show its robustness. In addition, we apply this method both in simulation and empirical investigation. Both the simulation results based on three typical stylized features of financial data and the empirical results in analyzing high-frequency financial data from Frankfurt Stock Exchange confirm that SOWDA significantly (based on the RMSE comparison) improves the performance of classical econometric models after denoising the data with the discrete wavelet transform (DWT) and maximal overlap discrete wavelet transform (MODWT) methods.
References
Aguiar-Conraria, L., M. M. F. Martins, and M. Soares. 2012. “The Yield Curve and the Macro-economy Across Time and Frequencies.” Journal of Economic Dynamics and Control 36: 1950–1970.10.1016/j.jedc.2012.05.008Search in Google Scholar
Birgé, L., and P. Massart. 1998. “Minimum Contrast Estimators on Sieves: Exponential Bounds and Rates of Convergence.” Bernoulli 4 (3): 329–375.10.2307/3318720Search in Google Scholar
Cai, T., and B. Silverman. 2001. “Incorporating Information on Neighboring Coefficients into Wavelet Estimation.” Sankhya: The Indian Journal of Statistics 63: 127–148.Search in Google Scholar
Chun, S., A. Shapiro, and S. Uryasev. 2012. “Conditional Value-at-Risk and Average Value-at-Risk: Estimation and Asymptotics.” Operations Research 60 (4): 739–756.10.1287/opre.1120.1072Search in Google Scholar
Connor, J., and R. Rossiter. 2005. “Wavelet Transforms and Commodity Prices.” Studies in Nonlinear Dynamics & Econometrics 9 (1): 433–465.10.2202/1558-3708.1170Search in Google Scholar
Crowley, P. 2007. “A Guide to Wavelets for Economists.” Journal of Economic Surveys 21 (2): 207–267.10.1111/j.1467-6419.2006.00502.xSearch in Google Scholar
Daubechies, I. 1992. Ten Lectures on Wavelets, volume 61 of CBMS-NSF Regional Conference Series in Applied Mathematics. Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA, 118.Search in Google Scholar
Donoho, D. L. 1994. “Asymptotic Minimax Risk for Sup-Norm Loss: Solution via Optimal Recovery.” Probability Theory and Related Fields 99: 145–170.10.1007/BF01199020Search in Google Scholar
Donoho, D., and I. Johnstone. 1994. “Ideal Spatial Adaptation by Wavelet Shrinkage.” Biometrika 81: 425–455.10.1093/biomet/81.3.425Search in Google Scholar
Donoho, D., and I. Johnstone. 1995. “Adapting to Unknown Smoothness via Wavelet Shrinkage.” Journal of the American Statistical Association 90 (432): 1200–1224.10.1080/01621459.1995.10476626Search in Google Scholar
Donoho, D., and I. Johnstone. 1998. “Minimax Estimation via Wavelet Shrinkage.” Annals of Statistics 26 (3): 879–921.10.1214/aos/1024691081Search in Google Scholar
Esteban-Bravo, M., and J. Vidal-Sanz. 2007. “Computing Continuous-time Growth Models with Boundary Conditions via Wavelets.” Journal of Economic Dynamics and Control 31 (11): 3614–3643.10.1016/j.jedc.2007.01.012Search in Google Scholar
Fan, J., and Y. Wang. 2007. “Multi-scale Jump and Volatility Analysis for High-Frequency Financial Data.” Journal of the American Statistical Association 102: 1349–1362.10.1198/016214507000001067Search in Google Scholar
Fan, Y., and R. Gençay. 2010. “Unit Root Tests with Wavelets.” Econometric Theory 26: 1305–1331.10.1017/S0266466609990594Search in Google Scholar
Gençay, R., and N. Gradojevic. 2011. “Errors-in-Variables Estimation with Wavelets.” Journal of Statistical Computation and Simulation 81 (11): 1545–1564.10.1080/00949655.2010.495073Search in Google Scholar
Gençay, R., F. Selçuk, and B. Whitcher. 2002. An Introduction to Wavelets and other Filtering Methods in Finance and Economics. San Diego, USA: Academic Press.10.1016/B978-012279670-8.50004-5Search in Google Scholar
Gençay, R., F. Selçuk, and B. Whitcher. 2003. “Systematic Risk and Timescales.” Quantitative Finance 3 (2): 108–116.10.1088/1469-7688/3/2/305Search in Google Scholar
Gençay, R., F. Selçuk, and B. Whitcher. 2005. “Multiscale systematic risk.” Journal of International Money and Finance 24: 55–70.10.1016/j.jimonfin.2004.10.003Search in Google Scholar
Gençay, R., N. Gradojevic, F. Selcuk, and B. Whitcher. 2010. “Asymmetry of Information Flow Between Volatilities Across Time Scales.” Quantitative Finance 10: 895–915.10.1080/14697680903460143Search in Google Scholar
Grubbs, F. 1969. “Procedures for Detecting Outlying Observations in Samples.” Technometrics 11: 1–21.10.1080/00401706.1969.10490657Search in Google Scholar
Haven, E., X. Liu, and L Shen. 2012. “De-noising Option Prices with the Wavelet Method.” European Journal of Operational Research 222 (1): 104–112.10.1016/j.ejor.2012.04.020Search in Google Scholar
Hong, Y., and C. Kao. 2004. “Wavelet-based Testing for Serial Correlation of Unknown Form In Panel Models.” Econometrica 72: 1519–1563.10.1111/j.1468-0262.2004.00542.xSearch in Google Scholar
In, F., S. Kim, and R. Gençay. 2011. “Investment Horizon Effect on Asset Allocation Between Value and Growth Strategies.” Economic Modelling 28: 1489–1497.10.1016/j.econmod.2011.02.028Search in Google Scholar
Jensen, M. 2007. “An Alternative Maximum Likelihood Estimator of Long-memory Processes using Compactly Supported Wavelets.” Journal of Economic Dynamics and Control 24: 361–387.10.1016/S0165-1889(99)00010-XSearch in Google Scholar
Keinert, F. 2004. Wavelets and Multiwavelets. Boca Raton, USA: Chapman & Hall/CRC.10.1201/9780203011591Search in Google Scholar
Kelly, D., and D. Steigerwald. 2004. “Private Information and High-frequency Stochastic Volatility.” Studies in Nonlinear Dynamics & Econometrics 8: 1–18.10.2202/1558-3708.1167Search in Google Scholar
Kim, S., and F. In. 2008. “The Relationship between Financial Variables and Real Economic Activity: Evidence from Spectral and Wavelet Analysis.” Studies in Nonlinear Dynamics and Econometrics 7: 22–45.10.2202/1558-3708.1183Search in Google Scholar
Lada, E., and J. Wilson. 2006. “A Wavelet-based Spectral Procedure for Steady-state Simulation Analysis.” European Journal of Operational Research 174 (3): 1769–1801.10.1016/j.ejor.2005.04.025Search in Google Scholar
Laukaitis, A. 2008. “Functional Data Analysis for Cash Flow and Transactions Intensity Continuous-Time Prediction Using Hilbert-Valued Autoregressive Processes.” European Journal of Operational Research 185 (3): 1607–1614.10.1016/j.ejor.2006.08.030Search in Google Scholar
Lee, S., and P. Mykland. 2008. “Jumps in Financial Markets: A New Nonparametric Test and Jump Dynamics.” Review of Financial Studies 21: 2535–2563.10.1093/rfs/hhm056Search in Google Scholar
Mallat, S. 1989. “A Theory for Multiresolution Signal Decomposition: The Wavelet Representation.” IEEE Transactions on Pattern Analysis and Machine Intelligence 11: 674–693.10.1109/34.192463Search in Google Scholar
Mallat, S., and W. Hwang. 1992. “Singularity Detection and Processing with Wavelets.” IEEE Transactions on Information Theory 38: 617–643.10.1109/18.119727Search in Google Scholar
Mandelbrot, B. 1982. The Fractal Geometry of Nature. W. H. Freeman & Co. Ltd, San Francisco, CA.Search in Google Scholar
McCulloch, R., and R. Tsay. 2004. “Nonlinearity in High-frequency Financial Data and Hierarchical Models.” Studies in Nonlinear Dynamics & Econometrics 5: 1–17.10.1162/108118201753421097Search in Google Scholar
Meinl, T., and E. Sun. 2012. “A Nonlinear Filtering Algorithm Based on Wavelet Transforms for High-frequency Financial Data Analysis.” Studies in Nonlinear Dynamics and Econometrics 16 (3): 5.10.1515/1558-3708.1920Search in Google Scholar
Morlet, J. 1983. “Sampling Theory and Wave Propagation.” Issues in Acoustic Signal/Image Processing and Recognition 1: 233–261.10.1007/978-3-642-82002-1_12Search in Google Scholar
Percival, D., and A. Walden. 2006. Wavelet Methods for Time Series Analysis. Cambridge, UK: Cambridge University Press.Search in Google Scholar
Ramsey, J. 2002. “Wavelets in Economics and Finance: Past and Future.” Studies in Nonlinear Dynamics and Econometrics 6: 1–27.10.2202/1558-3708.1090Search in Google Scholar
Ramsey, J., and C. Lampart. 1998. “The Decomposition of Economic Relationships by Time Scale Using Wavelets: Expenditure and Income.” Studies in Nonlinear Dynamics and Econometrics 3: 23–42.10.2202/1558-3708.1039Search in Google Scholar
Sun, E., and T. Meinl. 2012. “A New Wavelet-based Denoising Algorithm for High-frequency Financial Data Mining.” European Journal of Operational Research 217: 589–599.10.1016/j.ejor.2011.09.049Search in Google Scholar
Sun, W., S. Rachev, and F. Fabozzi. 2007. “Fractals or I.I.D.: Evidence of Long-Range Dependence and Heavy Tailedness from Modeling German Equity Market Returns.” Journal of Economics and Business 59: 575–595.10.1016/j.jeconbus.2007.02.001Search in Google Scholar
Sun, W., S. Rachev, S. Stoyan, and F. Fabozzi. 2008. “Multivariate Skewed Student’s t Copula in the Analysis of Nonlinear and Asymmetric Dependence in the German Equity Market.” Studies in Nonlinear Dynamics & Econometrics 12: 1–30.10.2202/1558-3708.1572Search in Google Scholar
Sun, W., S. Rachev, and F. Fabozzi. 2009. “A New Approach for Using Lèvy Processes for Determining High-Frequency Value-at-Risk Predictions.” European Financial Management 15: 340–361.10.1111/j.1468-036X.2008.00467.xSearch in Google Scholar
Sun, E., O. Rezania, S. Rachev, and F. Fabozzi. 2011. “Analysis of the Intraday Effects of Economic Releases on the Currency Market.” Journal of International Money and Finance 30 (4): 692–707.10.1016/j.jimonfin.2011.03.001Search in Google Scholar
Sun, E. W., T. Kruse, and M. T. Yu. 2014. “High Frequency Trading, Liquidity, and Execution Cost.” Annals of Operations Research 223: 403–432.10.1007/s10479-013-1382-8Search in Google Scholar
Xue, Y., R. Gençay, and S. Fagan. 2014. “Jump Detection with Wavelets for High-frequency Financial Time Series.” Quantitative Finance 14: 1427–1444.10.1080/14697688.2013.830320Search in Google Scholar
Supplemental Material
The online version of this article (DOI: 10.1515/snde-2014-0057) offers supplementary material, available to authorized users.
©2015 by De Gruyter
Articles in the same Issue
- Frontmatter
- A video interview of James Stock
- More powerful cointegration tests with non-normal errors
- Asset pricing with flexible beliefs
- Improving model performance with the integrated wavelet denoising method
- Noncausality and inflation persistence
- A triple-threshold leverage stochastic volatility model
- Estimating dynamic copula dependence using intraday data
Articles in the same Issue
- Frontmatter
- A video interview of James Stock
- More powerful cointegration tests with non-normal errors
- Asset pricing with flexible beliefs
- Improving model performance with the integrated wavelet denoising method
- Noncausality and inflation persistence
- A triple-threshold leverage stochastic volatility model
- Estimating dynamic copula dependence using intraday data