As we learn how to train smarter models on less data, it’ll become more and more interesting to see whether models like this can invent post-1930 math, science, etc. and make predictions.

[Edit: serves me right for not reading tfa. My points are well-covered]