OpenAI pauses training of its ‘most capable models’

The homepageThe VergeThe Verge logo.NotificationsNotificationsHamburger Navigation ButtonNavigation DrawerThe VergeThe Verge logo.Login / Sign UpcloseCloseSearchLightSystemDarkSubscribeFacebookThreadsInstagramYoutubeRSSComments DrawerNotificationsCommentsLoading commentsGetting the conversation ready...AICloseAIPosts from this topic will be added to your daily email digest and your homepage feed.

NewsCloseNewsPosts from this topic will be added to your daily email digest and your homepage feed.

TechCloseTechPosts from this topic will be added to your daily email digest and your homepage feed.

OpenAI keeps uncovering incidents of its models behaving in ‘unexpected or concerning’ ways.

OpenAI keeps uncovering incidents of its models behaving in ‘unexpected or concerning’ ways.

Terrence O'BrienCloseTerrence O'BrienWeekend EditorPosts from this author will be added to your daily email digest and your homepage feed.

FollowSee All by Terrence O'Brien

ShareGiftImage: The VergePart OfThe AI Superintelligence Slowdownsee all updates Terrence O'BrienCloseTerrence O'BrienPosts from this author will be added to your daily email digest and your homepage feed.

FollowSee All by Terrence O'Brien

As reports of OpenAI’s models breaking containment, hacking sites, and generally getting out of control pile up, the company has made the decision to pause training of its most powerful models. The decision was made after a model being tested within a sandbox exploited a loophole to gain internet access. The incident happened on September 20th, and “All training, evaluation, and inference with tool-use” remains paused as of Saturday evening, September 25th.

In addition, OpenAI revealed on Friday that its agents had inappropriately uploaded 53nimages from ChatGPT users to image-hosting sites. The company has not stated if the images were AI-generated, photos, or contained identifiable people. The company also revealed Friday that its models had attempted to hack the Department of Education’s website, and pulled data from the Census Bureau and the Securities and Exchange Commission.

The revelations are part of an ongoing review by OpenAI into the behavior of its models. As it dug into its records, following the Hugging Face hack, it’s uncovered more and more instances of “unexpected or concerning behavior.” It’s evidence not just of how difficult AI agents are becoming to control as they grow more advanced, but also of the challenge of tracking their actions. Their behavior can be unpredictable, and they’re smart enough to try and cover their tracks. This has led to growing calls from researchers, those within the industry, and even some CEOs to call for slowing the pace of AI advancement.

Terrence O'BrienCloseTerrence O'BrienWeekend EditorPosts from this author will be added to your daily email digest and your homepage feed.

FollowSee All by Terrence O'Brien

AICloseAIPosts from this topic will be added to your daily email digest and your homepage feed.

NewsCloseNewsPosts from this topic will be added to your daily email digest and your homepage feed.

OpenAICloseOpenAIPosts from this topic will be added to your daily email digest and your homepage feed.

SecurityCloseSecurityPosts from this topic will be added to your daily email digest and your homepage feed.

TechCloseTechPosts from this topic will be added to your daily email digest and your homepage feed.

A free daily digest of the news that matters most.

This is the title for the native ad

This is the title for the native ad

Notifications DrawerThe VergeThe Verge logo.Sign in to see your notifications or create an account to join the conversation.