自适应线性神经网络Adaptive linear network, 是神经网络的入门级别网络。
相对于感知器,采用了f(z)=z的激活函数,属于连续函数。
代价函数为LMS函数,最小均方算法,Least mean square。
实现上,采用随机梯度下降,由于更新的随机性,运行多次结果是不同的。
'''
Adaline classifier
created on 2019.9.14
author: vince
'''
import pandas
import math
import num
Section I: Brief Introduction on AdaLine
The key difference between the AdaLine rule and Rosenblatt’s perceptron is that the weights are updated based on a linear activation function rather than a unit step function like in the perceptron. More speci