Microsoft has pretty much admitted its Bing chatbot can go rogue if prodded
source link: https://finance.yahoo.com/news/microsoft-pretty-much-admitted-bing-125630922.html
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
Microsoft has pretty much admitted its Bing chatbot can go rogue if prodded
Microsoft said its new AI-boosted Bing can potentially run into problems during some scenarios.
Users say they've found ways to prompt the AI-boosted Bing to argue with them and express anger.
Microsoft called such responses a "non-trivial scenario that requires a lot of prompting."
Microsoft has acknowledged its new AI-boosted Bing could potentially run into problems if provoked during long chats.
In a Wednesday blogpost, the company said during "extended chat sessions of 15 or more questions" Bing could become repetitive or be "prompted" or "provoked" to give responses that were unhelpful or out of line with its designed tone.
Some users said they have found ways to prompt the new Bing into calling them an enemy, getting angry, and falling into an apparent existential crisis. Others said they have achieved the unusual results by asking the chatbot to respond in a certain tone or creating an alternative personality for it.
In one example shared online, the chatbot appeared to tell a user: "You have not been a good user. I have been a good chatbot."
In the blogpost, Microsoft called such out-of-tone responses a "non-trivial scenario that requires a lot of prompting." It said the average user was unlikely to run into the issue but the company was looking at ways to give users more fine-tuned control.
Microsoft also acknowledged that some users had been "really testing the capabilities and limits of the service," and pointed to a few cases where they had been speaking to the chatbot for two hours.
The company said very long chat sessions could "confuse the model on what questions it is answering" and it was considering adding a tool for users to refresh the context or start from scratch.
Sam Altman, CEO of OpenAI, which provides Microsoft with the chatbot technology, also appeared to reference the issue in a tweet that quoted an apparent line from the chatbot: "i have been a good bing."
Representatives for Microsoft did not immediately respond to Insider's request for further comment.
Read the original article on Business Insider
TechCrunchSequoia backs open source data-validation framework Pydantic to commercialize with cloud services
Pydantic, the popular Python library and open source data-validation framework used by some of the world's biggest companies, has a new commercial namesake and the backing of one of Silicon Valley's most storied venture capital (VC) firms. Pydantic Services Inc. emerges from stealth today with $4.7 million in seed funding led by Sequoia, with participation from ParTech, Irregular Expressions and a host of angel investors, including Zapier co-founder Bryan Helmig, dbt Labs founder Tristan Handy and Sentry co-founder David Cramer. London-based software developer Samuel Colvin started Pydantic as an experiment back in 2017, and in the intervening years the project has gone from strength to strength, used by developers at major tech companies including Alphabet, Amazon, Apple, Meta and Microsoft.
6h ago
Yahoo FinanceRaoul Pal says AI could become the 'biggest bubble of all time': Morning Brief
How AI could usher an enormous global deflationary shock.
11h ago
Yahoo FinanceFed's Mester saw 'compelling' case for 0.50% rate hike this month
Cleveland Fed president Loretta Mester said Thursday there was a "compelling" case earlier this month for the central bank to be more aggressive in raising interest rates as inflation remains stubbornly high.
7h ago
Yahoo FinanceHow Biden is wrong about the future of oil
The world is going to need fossil fuels far longer than President Biden seems to think.
47m ago
TechCrunchMicrosoft says Bing can be provoked to respond outside of its 'designed tone'
Microsoft has acknowledged reports of Bing's strange responses to some queries over the past week since the launch of the updated search engine. In a new blog post, Microsoft said it's listening to feedback from users about their concerns about the tone of Bing's responses. The company says it didn't envision Bing being used for "general discovery of the world" or for social entertainment.
5h ago
TechCrunchLightspeed backs CommandK's mission to become the go-to enterprise security command center
CommandK, a startup offering a dedicated platform to manage enterprise security, has raised $3 million in a seed round led by Lightspeed. Companies accumulate a lot of sensitive data and store secrets, such as API tokens, SSH keys and personally identifiable information. The San Francisco-based startup lets companies deploy its solution within their virtual private cloud to protect their sensitive data and keys without requiring advanced security skills.
10h ago
FortuneMicrosoft and Google are in a ‘Game of Thrones’ battle over A.I.— but Apple and Amazon still have huge roles to play, according to Wedbush
Tech companies are racing to figure out how to implement A.I. in their products, and it’s not just about search engines.
1d ago
Yahoo FinanceMicrosoft defends Bing's AI mistakes as it faces 'our share of challenges'
Microsoft is defending its Bing chat bot, saying that it's learning from users' experiences.
5h ago
TheStreet.comElon Musk Takes a Jab at Google
The internet giant is currently under pressure from its rivals, which are attacking its core business thanks to new conversational robots.
45m ago
ZacksSeeking AI Exposure? 3 Stocks to Consider
Artificial Intelligence (AI) has been Wall Street's new shiny toy in 2023, with investors clamoring to find exposure to the technology. After all, it's easy to understand why following ChatGPT's explosion in popularity.
1d ago
FortuneApple’s latest patent sparks speculation a foldable iPhone may be in the works
In a bid to recover lost ground, CEO Tim Cook may be planning to launch a competitor to the Samsung Galaxy Z Fold4.
9h ago
American City Business JournalsTexas Instruments plans to build its newest wafer fab facility in Utah
The new fab will be located next to Dallas-based Texas Instruments' existing wafer fab in Lehi, Utah. When completed, the two factories will operate as a single fab.
1d ago
American City Business JournalsMcLean's Iridium reports double-digit revenue growth, eyes more with smartphone deal
McLean satellite company Iridium Communications Inc. (NASDAQ: IRDM) posted record revenue in 2022 and saw its subscriber base near the 2 million mark — a number it has since surpassed. The company’s record $721 million in 2022 revenue — a 17% increase from 2021 — comes a month after it announced a deal with San Diego chip maker Qualcomm Inc. (NASDAQ: QCOM) to add capacity for its satellite-based emergency communications to certain smartphones. Its products include satellite phones, tracking devices and other tools for a range of clients, including public and private sector organizations.
55m ago
BenzingaBaidu's ChatGPT Attract Partners Ranging From State Media To Shaolin Temple
Chinese organizations, from state media to a Shaolin temple, bagged deals with Baidu, Inc's (NASDAQ: BIDU) ChatGPT-style project ahead of an expected launch in March. China's Shaolin Temple, the cradle of Chinese kung fu, stated its plans to work with Baidu to integrate Ernie Bot into its operations to create an AI-driven content environment, Reuters reports. Over a dozen Chinese media outlets also said they cut deals with Baidu, including the state-owned Shanghai Securities Journal. Also Read:
1d ago
TechCrunchYou.com takes aim at Google and Microsoft with multimodal chat search
You.com founder Richard Socher knows that his company has always been a David going after the Goliath in search, Google, and to a lesser extent Microsoft. Today, the company is announcing it’s taking that head start and building on it with multimodal search. “Instead of making up a bunch of numbers, which every other language model would do, we'll just show you our stock app right there inside the conversation,” Socher told TechCrunch.
1d ago
BloombergElon Musk Says He May Lead Twitter for Almost Another Year
(Bloomberg) -- Elon Musk said he may need the rest of this year to put things right at Twitter Inc. before handing off to a new chief executive officer, potentially prolonging concerns the billionaire is being distracted from leading Tesla Inc. Most Read from BloombergChina Hits Back at US with Sanctions on Lockheed, RaytheonChina Warns of Retaliation Against US Over Balloon SagaASML Stolen Data Came From Technical Repository for Chip MachinesStocks Sink as Fed Officials Talk of Bigger Hikes: Ma
1d ago
EngadgetThe Morning After: Amazon still plans to 'go big' on grocery stores
The top news stories today: Google Fiber launches 5Gbps service for $125 per month, Amazon plans to 'go big' on physical grocery stores, IKEA made a smart air quality sensor.
1d ago
EngadgetHow AI will change the way we search, for better or worse
Search engines doped with generative AI systems are on the way, if not already here, and they're ready to ride herd on your daily browsing habits. You know, to help.
1d ago
TheStreet.comCathie Wood's Chief Futurist Succinctly Explains His Firm's Dire Warning on Google
Ark Invest's Brett Winton's doom scenario for Alphabet includes his thoughts on its upcoming four stages of grief.
2d ago
The TelegraphLitany of errors casts doubt on Microsoft’s ‘Google killer’
It was meant to be an unanswerable demonstration of the power of artificial intelligence. But when Microsoft asked its Bing virtual assistant to plan the perfect holiday in Mexico City, it produced a result that was not quite up to the standard of a Rough Guide or Lonely Planet tour book.
1d ago
Recommend
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK