Weight visualization of 0-layer autoencoder on MNIST

 

Border pixels are always 0 in MNIST and thus do not receive training signal; other pixels learn the identity function for their corresponding picture in the input.