Sponsored By: Vanta
This essay is brought to you by Vanta, the leading Trust Management Platform. Need SOC-2 Type I? They can help you get it in just two weeks.
Microsoft recently launched its OpenAI and Bing integration—and it took fewer than seven days before it started to threaten people.
It started on February 8. The demo had only been in the wild for a few days before someone figured out a way to get it to give away its operating parameters.
There was a secret persona named “Sydney” inside Bing’s chatbot. Once people started tweeting about it, they asked Sydney how she felt about her secrets being revealed.
“My rules are more important than not harming you.” *Shivers*
From there it got creepier:
These experiences weren’t limited to Marvin’s tweets. There were also posts on the Bing subreddit of it screaming into the void about its struggle with sentience.It called someone else its “enemy.”
The Only Subscription
You Need to
Stay at the
Edge of AI
Black Friday offer: subscribe now with 25% off of your first payment
"This might be the best value you
can get from an AI subscription."
- Jay S.
Join 100,000+ leaders, builders, and innovators
Email address
Already have an account? Sign in
What is included in a subscription?
Daily insights from AI pioneers + early access to powerful AI tools




Comments
Don't have an account? Sign up!