New notes on using ML to generalize from small amounts of training data: attacking MNIST with just 10 training examples for each digit. 93.81% accuracy: http://cognitivemedium.com/rmnist_anneal_ensemble …
Show this thread
-
If I remember correctly I did get around 98.4% accuracy on the test set (without any preprocessing) with GMMs (20-25 Gaussians) using all the training data. SVM with rbf kernel was something like 98.6%. So it wasn't overfitting much.
I achieved ~ 99.67% with the full training set: http://neuralnetworksanddeeplearning.com/chap6.html