Skip to content
KPI Science News
ISSN 2617-5509 · e‑ISSN 2663-7472 Open Access · CC BY 4.0
Vol. · Issue 1 · 2021 May 28, 2021 article

DATA FILTERING TECHNIQUES IN DECISION SUPPORT SYSTEMS

RP
Roman L. Pantyeyev Corresponding National Aviation University , Ukraine Ukraine
OT
Oksana L. Timoshchuk Igor Sikorsky Kyiv Polytechnic Institute , Ukraine Ukraine
VH
Vira H. Huskova Igor Sikorsky Kyiv Polytechnic Institute , Ukraine Ukraine
PB
Petro I. Bidyuk Igor Sikorsky Kyiv Polytechnic Institute , Ukraine Ukraine
PublishedMay 28, 2021
PDF (Ukrainian)
KPISN 1 VOL · 1
VOL · ISS 1 · 2021 View issue

Abstract

Background. The majority of modern dynamic processes in economy, finances, ecology, technologies and many other areas of studies exhibit short- and long-term nonlinear and nonstationary behavior. That is why it is required to create for their thorough analysis modern highly developed specialized instrumentation providing for appropriate preliminary statistical data processing, simulation state and parameter estimation and quality forecasting their evolution in time to be used in decision support systems (DSS). Objective. The purpose of the paper is to perform introductory analysis of some modern methods for filtering statistical and experimental data; to consider modern filtering techniques on the basis of probabilistic Bayesian approach, that provide a possibility for preparing the data to adequate simulation, computing high quality state and forecast estimates for dynamic systems in stochastic environment and availability of measurement errors. Methods. To implement modern data filtering techniques appropriate simulation and optimization procedures, probabilistic Bayesian methods of data analysis are utilized; simulation algorithms for parameter estimation, and criteria bases for analyzing quality of intermediate and final results in the frames of DSS are used. Results. A set of data filtering techniques is presented to be used together with the models describing formally selected processes dynamics. The methodology is considered for implementation of probabilistic Bayesian filter based upon modern statistical data analysis techniques including application of appropriate simulation procedures. Conclusions. Development of effective means for simulation, state estimation and forecasting dynamics of nonlinear nonstationary processes in various areas of human activities provides a possibility for high quality state and parameter estimation and compute short and middle term forecasts for their future evolution. The methods of optimal Kalman and probabilistic Bayesian filtering considered in the review provide a possibility for performing appropriate analysis of nonlinear nonstationary processes, compute forecasts and provide for managerial decision support on the basis of the forecast estimates.

Keywords

#data analysis #nonlinear nonstationary processes #methods of optimal and probabilistic filtering #simulation

References

  1. B.D.O. Anderson and J.B. Moore, Optimal Filtering. Englewood Cliffs: Prentice-Hall, 1979, 357 p.
  2. P.І. Bidyuk et al., Time Series Analysis. Kyiv, Ukraine: Polytechnika, 2013.
  3. S.M. Kay, Fundamentals of Statistical Signal Processing: Estimation Theory. Upper Saddle River: Prentice Hall PTR, 1993, 595 p.
  4. C.K. Chui and G. Chen, Kalman Filtering with Real-Time Applications. Berlin: Springer-Verlag, 2009, 229 p. doi: 10.1007/978-3-540-87849-0
  5. S. Haykin, Adaptive Filtering Theory, 4th ed. Upper Saddle River: Prentice-Hall, 2002, 936 p.
  6. M.Z. Zgurovskii and V.N. Podladchikov, Analytical Methods of Kalman Filtering. Kyiv, Ukraine: Naukova Dumka, 1995, 285 p.
  7. S.J. Press, Subjective and Objective Bayesian Statistics. Hoboken: John Wiley & Sons, 2003. doi: 10.1002/9780470317105
  8. A. Pole et al., Applied Bayesian Forecasting and Time Series Analysis. Boca Raton: Chapman & Hall/CRC, 2000.
  9. B.P. Gibbs, Advanced Kalman Filtering, Least-Squares and Modeling. Hoboken: John Wiley & Sons, 2011, 627 p. doi: 10.1002/9780470890042
  10. J.L. Anderson, “An ensemble adjustment Kalman filter for data assimilation for data assimilation,” Monthly Weather Rev., vol. 129, pp. 2284–2903, 2001.
  11. U. Lerner et al., “Bayesian fault detection and diagnosis in dynamic systems,” in Proc. Seventeenth National Conf. Artificial Intelligence, Austin, Texas, 2000, pp. 531–537.
  12. S.J. Julier and J.K. Uhlmann, “Unscented filtering and nonlinear estimation,” Proc. IEEE, vol. 92, no. 3, pp. 401–422, 2004. doi: 10.1109/JPROC.2003.823141
  13. X. Luo and I.M. Moroz, “Ensemble Kalman filters with the unscented transform,” Physica D: Nonlinear Phenomena, vol. 238, no. 5, pp. 549–562. doi: 10.1016/j.physd.2008.12.003
  14. I.R. Petersen and A.V. Savkin, Robust Kalman Filtering for Signals and Systems with Large Uncertainties. Basel: Birkhäuser, 1999, 207 p. doi: 10.1007/978-1-4612-1594-3
  15. H.M.T. Menegaz et al., “A systematization of the unscented Kalman filter theory,” IEEE Trans. Autom. Control, vol. 60, no.10, pp. 2583–2598, 2015. doi: 10.1109/TAC.2015.2404511
  16. A.J. Haug, “A Tutorial on Bayesian Estimation and Tracking Techniques Applicable to Nonlinear and Non-Gaussian Processes,” MITRE Corp., McLean, Virginia, MTR 05W0000004, Jan 2005.
  17. F. Gustafsson, “Particle filter theory and practice with positioning applications,” IEEE Aerosp. Electron. Syst. Mag., vol. 25, no. 7, pp. 53–82, 2010. doi: 10.1109/MAES.2010.5546308
  18. K. Ito and K. Xiong, “Gaussian filters for nonlinear filtering problems,” IEEE Trans. Automatic Control, vol. 45, no. 5, pp. 910–927, 2000. doi: 10.1109/9.855552
  19. M.S. Arulampalam et. al., “A tutorial on particle filters for online nonlinear/non-gaussian bayesian tracking,” IEEE Trans. Signal Process., vol. 50, no. 2, pp. 174–188, 2002.
  20. D. Fox et al., “Monte Carlo localization: Efficient position estimation for mobile robots,” in Proc. Sixteenth Nat. Conf. on Artificial Intelligence and Eleventh Conference on Innovative Applications of Artificial Intelligence, Orlando, Florida, 1999, pp. 343–349.
  21. J. Röwekämper et al., “On the position accuracy of mobile robot localization based on particle filters combined with scan matching,” in IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, Vilamoura-Algarve, Portugal, 2012, pp. 3158–3164. doi: 10.1109/IROS.2012.6385988
  22. B.W. Silverman, Density estimation for statistics and data analysis. London: Chapman & Hall, 1986, 175 p.
  23. Particle_filter_demo [Online]. Available: https://github.com/mjl/particle_filter_demo
§ 06 — Related

Similar articles in this journal

Related peer-reviewed studies published in this journal.
View all issues

AN APPROACH TO CONSTRUCTING AN INFORMATIVE FEATURE SPACE OF TECHNICAL INDICATORS FOR FINANCIAL PROCESSES BASED ON NEURAL NETWORK MODELS

Roman Tertychnyi, Denys Chuprin, Petro Bidyuk

Background. Financial time series are characterized by nonlinearity, non-stationarity, and a high level of noise, which significantly complicates their modeling and…

#informative feature space construction approach #technical indicators #Parkinson volatility #neural networks
10.20535/kpisn.2026.3.359610

Most read articles by the same author(s)

Similar Articles

1-10 of 135

You may also start an advanced similarity search for this article.