In his keynote at YC’s AI Startup School earlier this week, Andrej Karpathy talks about how software development is changing with what he calls a third paradigm of programming. The first he calls Software 1.0 and is composed of normal code. Software 2.0 is the weights in a neural net that categorize things in a fixed-function kind of way. Software 3.0 is where the neural nets become programmable with English. In order to succeed, we’re going to have to be good at using all three of these paradigms together.