Right in the middle of this AMA of Geoff Hinton, there is this question:
Hi Professor Hinton, Since you joined Google lately, will your research there be proprietary? I’m just worried that the research done by one of the most important researchers in the field is being closed to a specific company.
And Hinton replies:
Actually, Google encourages us to publish. The main thing I have been working on is my capsules theory and I haven’t published because I haven’t got it to work to my satisfaction yet.
At this point, not googling “capsules theory” is a complete impossibility.
Lo and behold, it is a real thing. And Hinton has even made a mnist-proof-of-concept of it.
I don’t want to overhype the capsule learning, but so far, it is the only learning algorithm (that I know of) that can do tufa learning.
At the end of the talk, Tenenbaum seems to have some nice objections, although Hinton doesn’t repeat them. (His complaint probably has “probabilistic”, “bayesian” or “probabilistic programming” in it)