OpenAI Co-Founder Andrej Karpathy: ‘Rein in AI for Safety’

Andrej Karpathy cautions against the over-excitement surrounding AI, particularly in deploying unsupervised agents. Speaking at a Y Combinator event, he emphasized the need to “keep AI on the leash,” highlighting the persistent mistakes made by large language models (LLMs), which can inaccurately claim facts or make basic errors. Even though LLMs can generate substantial amounts of code rapidly, Karpathy insists that developers must not relinquish control, as they remain the essential quality check. He advocates for a cautious approach, emphasizing the importance of concrete prompts to ensure accurate outputs. This sentiment is echoed by other experts, including Bob McGrew and Kent Beck, who stress the indispensable role of human engineers in managing AI complexities and preventing unpredictable outcomes. Despite AI’s potential, tech companies are increasingly integrating it into coding processes, with Alphabet reporting that AI is responsible for over 30% of their new code.

Source link