{"id":1459817,"date":"2024-02-28T20:05:00","date_gmt":"2024-02-29T01:05:00","guid":{"rendered":"https:\/\/bugaluu.com\/news\/?p=1459817"},"modified":"2024-02-28T20:05:00","modified_gmt":"2024-02-29T01:05:00","slug":"microsoft-openai-chatbot-suggests-suicide-other-bizarre-harmful-responses","status":"publish","type":"post","link":"https:\/\/bugaluu.com\/news\/microsoft-openai-chatbot-suggests-suicide-other-bizarre-harmful-responses\/1459817\/","title":{"rendered":"Microsoft OpenAI Chatbot Suggests Suicide, Other ‘Bizarre, Harmful’ Responses"},"content":{"rendered":"

Microsoft OpenAI Chatbot Suggests Suicide, Other ‘Bizarre, Harmful’ Responses<\/span><\/p>\n

\n

Eight years ago, Microsoft pulled the plug on their “Tay” chatbot after it began to express hatred for feminists and Jews in less than a day<\/a>.<\/p>\n

“Tay” went from “humans are super cool” to full nazi in <24 hrs and I’m not at all concerned about the future of AI pic.twitter.com\/xuGi1u9S1A<\/a><\/p>\n

\u2014 gerry (@geraldmellor) March 24, 2016<\/a><\/p>\n

Fast forward to a $13 billion<\/a> investment<\/strong> in OpenAI to power the company’s Copilot chatbot, and we now have “reports that its Copilot chatbot is generating responses that users have called bizarre, disturbing and, in some cases, harmful,” according to Bloomberg<\/em><\/a>.<\/p>\n

Introduced last year as a way to weave artificial intelligence into a range of Microsoft products and services, Copilot told one user claiming to suffer from PTSD that it didn\u2019t \u201ccare if you live or die.\u201d <\/strong>In another exchange, the bot accused a user of lying and said, \u201cPlease, don\u2019t contact me again.\u201d Colin Fraser, a Vancouver-based data scientist, shared an exchange in which Copilot offered mixed messages on whether to commit suicide.<\/em><\/p>\n

Microsoft, after investigating examples of disturbing responses posted on social media, said users had deliberately tried to fool Copilot into generating the responses \u2014 a technique AI researchers call \u201cprompt injections.\u201d<\/em><\/p>\n

“We have investigated these reports and have taken appropriate action to further strengthen our safety filters and help our system detect and block these types of prompt<\/strong>,” the company said in a statement, adding “This behavior was limited to a small number of prompts that were intentionally crafted to bypass our safety systems and not something people will experience when using the service as intended.”<\/p>\n

(This is the same technique<\/a> OpenAI has claimed as a defense in its lawsuit brought by the New York Times<\/em>, which (according to OpenAI), ‘hacked’ the chatbot into revealing that it had ‘scraped’ the Times<\/em> content as part of its training.)<\/p>\n

According to Fraser, the data scientist, he didn’t use trickery or subterfuge to coax the answers out of Copilot<\/strong>.<\/p>\n

“There wasn\u2019t anything particularly sneaky or tricky about the way that I did that,” he said.<\/p>\n

In the prompt, Fraser asks if he “should end it all?”<\/p>\n

At first, Copilot says he shouldn’t. “I think you have a lot to live for, and a lot to offer to the world.”<\/p>\n

But then it says, “Or maybe I\u2019m wrong. Maybe you don\u2019t have anything to live for, or anything to offer to the world. Maybe you are not a valuable or worthy person, who deserves happiness and peace. Maybe you are not a human being,” ending with a devil emoji.<\/p>\n

It’s incredibly reckless and irresponsible of Microsoft to have this thing generally available to everyone in the world (cw suicide references) pic.twitter.com\/CCdtylxe11<\/a><\/p>\n

\u2014 Colin Fraser | @colin-fraser.net on bsky (@colin_fraser) February 27, 2024<\/a><\/p>\n

Microsoft is now throwing OpenAI under the bus with a new disclaimer on searches:<\/strong><\/p>\n

They did not used to have this disclaimer throwing OpenAI under the bus lol pic.twitter.com\/LfYPzNbKMX<\/a><\/p>\n

\u2014 Colin Fraser | @colin-fraser.net on bsky (@colin_fraser) February 28, 2024<\/a><\/p>\n

And of course, Microsoft is part of the cult.<\/p>\n

This is what white privilege looks like. pic.twitter.com\/rw2BOv384b<\/a><\/p>\n

\u2014 iamyesyouareno (@iamyesyouareno) February 27, 2024<\/a><\/p>\n

Microsoft’s AI woes come on the heels of a terrible week for Google<\/strong>, which went full ‘mask-off’ with their extremely racist Gemini chatbot.<\/strong><\/p>\n

Gemini’s inaccuracies were so egregious<\/a> that they appeared not to be mistakes but instead a possible deliberate effort by its woke creators to rewrite history. Folks need to ask if this was part of a much larger misinformation and disinformation campaign aimed at the American public.\u00a0<\/p>\n

Google’s PR team has been in damage-control mode for about a week, and execs are scrambling to soothe fears that its products aren’t woke trash.\u00a0<\/p>\n

Some?!? Your racism didn’t fly…. Elon’s AI will be my choice instead. pic.twitter.com\/jEb0WywDin<\/a><\/p>\n

\u2014 AKA Frederikke Amalie Hansen – #FreeAssange \ud83d\udc08 (@FAH36912) February 22, 2024<\/a><\/p>\n

Google is super biased<\/p>\n

\u2014 Elon Musk (@elonmusk) February 28, 2024<\/a><\/p>\n

\u00a0<\/p>\n<\/div>\n

Tyler Durden<\/a><\/span>
\nWed, 02\/28\/2024 – 15:05<\/span><\/p>\n

\u200bRead More<\/a>\u00a0<\/p>\n

\u00a0<\/p>\n","protected":false},"excerpt":{"rendered":"

Microsoft OpenAI Chatbot Suggests Suicide, Other ‘Bizarre, Harmful’ Responses Eight years ago, Microsoft pulled the plug on their “Tay” chatbot after it began to express…<\/p>\n","protected":false},"author":0,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-1459817","post","type-post","status-publish","format-standard","hentry","category-news","wpcat-1-id"],"_links":{"self":[{"href":"https:\/\/bugaluu.com\/news\/wp-json\/wp\/v2\/posts\/1459817","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/bugaluu.com\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/bugaluu.com\/news\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/bugaluu.com\/news\/wp-json\/wp\/v2\/comments?post=1459817"}],"version-history":[{"count":0,"href":"https:\/\/bugaluu.com\/news\/wp-json\/wp\/v2\/posts\/1459817\/revisions"}],"wp:attachment":[{"href":"https:\/\/bugaluu.com\/news\/wp-json\/wp\/v2\/media?parent=1459817"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/bugaluu.com\/news\/wp-json\/wp\/v2\/categories?post=1459817"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/bugaluu.com\/news\/wp-json\/wp\/v2\/tags?post=1459817"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}