By the same token (heh), the only reason why SOTA models got so good at programming and cybersecurity is that they trained on manual code, so I don’t mean to trivialize the human shoulders on which AI stands. But the SWEs had to crawl so that AI could run.