Artificial Neural Networks with Java

Igor Livshin is a senior architect with extensive experience in developing large-scale applications. He worked for many years for two large insurance companies: CNN and Blue Cross & Blue Shield of Illinois. He currently works as a senior researcher at DevTechnologies specializing in AI and neural networks. Igor has a master’s degree in computer science from the Institute of Technology in Odessa, Russia/Ukraine.   

Part One. Getting Started with Neural NetworksChapter 1.  Learning Neural Network 
Biological and Artificial Neurons Activation Functions Summary
Chapter 2.  Internal Mechanism of Neural Network Processing
Function to be ApproximatedNetwork Architecture Forward Pass Calculations Back-Propagation Pass CalculationsFunction derivative and function divergent Table of Most Commonly Used Function DerivativesSummary 

Chapter 3.  Manual Neural Network Processing 
Example 1. Manual Approximation of a Function at a Single Point  Building the Neural Network Forward pass calculation Backward Pass Calculation     Calculating Weight Adjustments for the Output Layer Neurons     Calculating Weight Adjustments for the Hidden Layer Neurons    Updating  Network Biases Back to the Forward PassMatrix Form of Network CalculationDigging Deeper Mini-Batches and Stochastic Gradient Summary

Part Two. Neural Network Java Development Environment Chapter 4.  Configuring Your Development Environment 
Installing Java 8 Environment on Your Windows MachineInstalling NetBeans IDEInstalling Encog Java Framework Installing XChart Package Summary
Chapter 5.  Neural Network Development Using Java EncogFramework 
Example 2. Function Approximation using Java environmentNetwork Architecture Normalizing the Input datasets Building the Java Program that Normalizes Both DatasetsProgram Code Debugging and Executing the Program Processing Results for the Training Method Testing the Network Testing Results Digging deeper.Summary 
Part Three. Development Non-Trivial Neural Network ApplicationsChapter 6.  Neural Network Prediction Outside of the Training Range Example 3a. Approximating Periodic Functions Outside of the Training RangeNetwork Architecture for Example 3aProgram Code for Example 3aTesting The NetworkExample 3b. Correct Way of Approximating Periodic Functions Outside of the Training RangePreparing the Training DataNetwork Architecture for the Example 3bProgram Code for Example 3bTraining Results for Example 3bTesting Results for Example 3b Summary 
Chapter 7.  Processing Complex Periodic FunctionsExample 4. Approximation of a Complex Periodic FunctionData Preparation Reflecting Function Topology in DataNetwork Architecture Program CodeTesting the Network Digging DeeperSummary 
Chapter 8.  Approximating Non-Continuous Functions Example 5. Approximating Non-Continuous FunctionsApproximating Non-Continuous Function Using Conventional Network Process . . . . . . .Network ArchitectureProgram CodeCode Fragments for the Training ProcessUnsatisfactory Training ResultsApproximating the Non-Continuous Function Using Micro-Bach MethodProgram Code for Micro-Batch processingProgram Code for the getChart() MethodCode Fragment 1 of the Training MethodCode Fragment 2 of the Training MethodTraining Results for Micro-Batch methodTest Processing LogicTesting Results for Micro-Batch methodDigging DeeperSummary 
Chapter 9. Approximation Continuous Functions with Complex TopologyExample 5a. Approximation of Continuous Function with Complex Topology Network Architecture for Example 5aProgram Code for Example 5aTraining Processing Results for Example 5aApproximation of Continuous Function with Complex Topology Using  Micro-Batch Method Program Code for Example 5a Using Micro-Batch MethodExample 5b. Approximation of Spiral-Like Functions Network Architecture for Example 5bProgram Code for Example 5bApproximation of the Same Functions Using Micro-Batch MethodSummary 

Chapter 10.  Using Neural Network for Classification of Objects
Example 6. Classification of records Training Dataset Network Architecture Testing Dataset Program Code for Data NormalizationProgram Code for Classification Training ResultsTesting Results Summary Chapter 11.  Importance of Selecting a Correct Model
Example 7.  Predicting Next Month Stock Market Price. .  Data PreparationIncluding Function Topology in the Dataset Building Micro-Batch FilesNetwork ArchitectureProgram Code Training Process Training Results.Testing ProcessTest Processing LogicTesting ResultsAnalyzing Testing Results Summary Chapter 12. Approximation of Functions in 3-D Space Example 8.  Approximation of Functions in 3-D Space Data Preparation Network ArchitectureProgram Code Processing Results Summary