Entropy Randomization in Machine Learning

Yuri S. Popkov: Doctor of Engineering, Professor, Academician of Russian Academy of Sciences; Chief Researcher at Federal Research Center “Computer Science and Control,” Russian Academy of Sciences; Chief Researcher at Trapeznikov Institute of Control Sciences, Russian Academy of Sciences; Professor at Lomonosov Moscow State University. Author of more than 250 scientific publications, including 15 monographs. His research interests include stochastic dynamic systems, optimization, machine learning, and macrosystem modeling. Alexey Yu. Popkov: Candidate of Sciences, Leading Researcher at Federal Research Center “Computer Science and Control,” Russian Academy of Sciences; author of 47 scientific publications. His research interests include software engineering, high-performance computing, data mining, machine learning, and entropy methods. Yuri A. Dubnov: MSc in Physics, Researcher at Federal Research Center “Computer Science and Control,” Russian Academy of Sciences. Author of more than 18 scientific publications. His research interests include machine learning, forecasting, randomized approaches, and Bayesian estimation.

Preface

1. General Concept of Machine Learning

2. Data Sources and Models Chapter

3. Dimension Reduction Methods

4. Randomized Parametric Models

5. Entropy-robust Estimation Procedures for Randomized Models and Measurement Noises

6. Entropy-Robust Estimation Methods for Probabilities of Belonging in Machine Learning Procedures

7. Computational Methods od Randomized Machine Learning

8. Generation Methods for Random Vectors with Given Probability Density Functions over Compact Sets

9. Information Technologies of Randomized Machine Learning

10. Entropy Classification

11. Randomized Machine Learning in Problems of Dynamic Regression and Prediction

Appendix A: Maximum Entropy Estimate (MEE) and Its Asymptotic Efficiency

Appendix B: Approximate Estimation of Structural Characteristics of Linear Dynamic Regression Model (LDR)

Bibliography