Skip to content

A python library for a fully-connected, multi-layer neural network, without the use of Matrices.

Notifications You must be signed in to change notification settings

DannyOppenheimer/Deep_Neural_Network

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

19 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Artificial Neural Network Battle Plan

Have layers of neurons as neuron objects in an array

Index 0: IN IN IN IN IN IN

Index 1: - H H H H H

Index 2: -- H H H H

Index 3: ---- H H

Index 4: ------ O

For each of these layers, create a connection object forwards and backwards to respective neurons (meaning its all connected)

Steps:

Feed Forward:

  1. Check to make sure the input works for the model
  2. Then, set the input neurons with their input values
  3. For every other neuron starting at layer 1, set their value to the values from all connected neurons, multiplied by all connected weights, and added to its bias. (All this is squished by a sigmoid function)
  4. Stop at output

Back Propagate:

  1. FOR ERROR
  2. Calculate error for output layer: (known answer - system guess)
  3. Calculate error for all of the hidden layers, back to front

((Forward_Weight₁ * Forward_Neuron₁) + (Forward_Weight₂ * Forward_Neuron₂) ...)

  1. FOR WEIGHTS:
  2. output of the hidden layer passed through the derivative of sigmoid
  3. multiply above by the output errors of the neurons
  4. multiply above my the learning rate
  5. multiply above by the input of the last neuron

learning rate * hidden error * derivative(hidden) * input

  1. FOR BIASES
  2. output of the hidden layer passed through the derivative of sigmoid
  3. multiply above by the output errors of the neurons
  4. multiply above my the learning rate

learning rate * hidden error * derivative(hidden)

About

A python library for a fully-connected, multi-layer neural network, without the use of Matrices.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages