OpenAI loses one other lead security researcher, Lilian Weng


One other considered one of OpenAI’s lead security researchers, Lilian Weng, introduced on Friday she is departing the startup. Weng served as VP of analysis and security since August, and earlier than that, was the pinnacle of the OpenAI’s security techniques group.

In a publish on X, Weng mentioned that “after 7 years at OpenAI, I really feel able to reset and discover one thing new.” Weng mentioned her final day can be November fifteenth, however didn’t specify the place she’s going to go subsequent.

“I made the extraordinarily troublesome determination to go away OpenAI,” mentioned Weng within the publish. “Taking a look at what now we have achieved, I’m so pleased with everybody on the Security Techniques group and I’ve extraordinarily excessive confidence that the group will proceed thriving.”

Weng’s departure marks the newest in an extended string of AI security researchers, coverage researchers, and different executives who’ve exited the corporate within the final yr, and several other have accused OpenAI of prioritizing business merchandise over AI security. Weng joins Ilya Sutskever and Jan Leike – the leaders of OpenAI’s now dissolved Superalignment group, which tried to develop strategies to steer superintelligent AI techniques – who additionally left the startup this yr to work on AI security elsewhere.

Weng first joined OpenAI in 2018, in accordance with her LinkedIn, engaged on the startup’s robotics group that ended up constructing a robotic hand that might remedy a Rubik’s dice – a activity that took two years to realize, in accordance with her publish.

As OpenAI began focusing extra on the GPT paradigm, so did Weng. The researcher transitioned to assist construct the startup’s utilized AI analysis group in 2021. Following the launch of GPT-4, Weng was tasked with making a devoted group to construct security techniques for the startup in 2023. At the moment, OpenAI’s security techniques unit has greater than 80 scientists, researchers, and coverage consultants, in accordance with Weng’s publish.

That’s a variety of AI security of us, however many have raised considerations round OpenAI’s give attention to security because it tries to construct more and more highly effective AI techniques. Miles Brundage, a longtime coverage researcher, left the startup in October and introduced that OpenAI was dissolving its AGI readiness group, which he had suggested. On the identical day, the New York Instances profiled a former OpenAI researcher, Suchir Balaji, who mentioned he left OpenAI as a result of he thought the startup’s expertise would convey extra hurt than profit to society.

OpenAI tells TechCrunch that executives and security researchers are engaged on a transition to switch Weng.

“We deeply recognize Lilian’s contributions to breakthrough security analysis and constructing rigorous technical safeguards,” mentioned an OpenAI spokesperson in an emailed assertion. “We’re assured the Security Techniques group will proceed taking part in a key position in guaranteeing our techniques are secure and dependable, serving tons of of tens of millions of individuals globally.”

Different executives who’ve left OpenAI in latest months embody CTO Mira Murati, chief analysis officer Bob McGrew, and analysis VP Barret Zoph. In August, the distinguished researcher Andrej Karpathy and co-founder John Schulman additionally introduced they’d be leaving the startup. A few of these of us, together with Leike and Schulman, left to affix an OpenAI competitor, Anthropic, whereas others have gone on to start out their very own ventures.

Leave a Reply

Your email address will not be published. Required fields are marked *