Terence Tao on “prematurely solving [a maths] problem by purely AI-powered methods”

I recommend reading the whole thread, but I linked to the part I found the most relevant. I believe the same is true for programming.