One Epoch is when an ENTIRE dataset is passed forward and backward through the neural network only ONCE.