A student network can learn to read handwritten digits without being shown a single digit. It never sees an image of one. It never sees a label. Its whole training diet is random static, and the only thing it is asked to do is copy a few extra numbers that a teacher network produces.
