Linear Classifiers
27
Linear Classifiers
• Linear classifiers: A choice of H
h𝑥;𝜃,𝜃0 =𝑠𝑖𝑔𝑛𝜃𝑇𝑥+𝜃0 =ቊ+1if𝜃𝑇𝑥+𝜃0>0
−1 otherwise
𝑥2
𝑥1
28
The random linear classifier algorithm
hyperparameter
random_linear_classifier(D, k): for j=1 to k
𝜃(𝑗) = random(R𝑑); 𝜃(𝑗) = random(R)
j*=argminE𝑛(𝜃𝑗 ,𝜃(𝑗)) 𝑗∈{1..𝑘} 0
return(𝜃(𝑗∗), 𝜃(𝑗∗)) 0
0
29