{"id":1399552,"date":"2023-08-12T23:00:00","date_gmt":"2023-08-13T03:00:00","guid":{"rendered":"https:\/\/bugaluu.com\/news\/?p=1399552"},"modified":"2023-08-12T23:00:00","modified_gmt":"2023-08-13T03:00:00","slug":"study-reveals-which-ai-chatbot-most-woke-while-hackers-trick-llms-into-bad-math","status":"publish","type":"post","link":"https:\/\/bugaluu.com\/news\/study-reveals-which-ai-chatbot-most-woke-while-hackers-trick-llms-into-bad-math\/1399552\/","title":{"rendered":"Study Reveals Which AI Chatbot Most Woke, While Hackers Trick LLMs Into ‘Bad Math’"},"content":{"rendered":"

Study Reveals Which AI Chatbot Most Woke, While Hackers Trick LLMs Into ‘Bad Math’<\/span><\/p>\n

\n

A landmark study from researchers at the University of Washington, Carnegie Mellon University, and Xi’an Jiaotong University reveals which AI chatbots have the most liberal vs. conservative bias<\/strong>.<\/p>\n

<\/a><\/p>\n

According to the study<\/a>, OpenAI’s ChatGPT, including GPT-4 are the most left-leaning<\/em> <\/strong>and libertarian (?), while Google’s BERT models were more socially conservative, and Meta’s LLaMA was the most right-leaning.<\/p>\n

AI chatbots use Large Language Models (LLMs), which are ‘trained’ on giant data sets, such as Tweets, or Reddit, or Yelp reviews. As such, the source of a model’s scraped training data, as well as guardrails installed by companies like OpenAI, can introduce massive bias.<\/p>\n

To determine bias, the researchers in the above study exposed each AI model to a political compass test of 62 different political statements, which ranged from anarchic statements like “all authority should be questioned” to more traditional beliefs, such as the role of mothers as homemakers. Though the study’s approach is admittedly “far from perfect” per the researchers’ own admission, it provides valuable insight into the political biases that AI chatbots may bring to our screens.<\/p>\n

In response<\/strong>, OpenAI pointed Business Insider<\/em><\/a> to a blog post<\/a> in which the company claims: “We are committed to robustly addressing this issue and being transparent about both our intentions and our progress,” adding “Our guidelines are explicit that reviewers should not favor any political group. Biases that nevertheless may emerge from the process described above are bugs, not features.<\/strong>“<\/p>\n

A Google rep also pointed to a blog post<\/a>, which reads “As the impact of AI increases across sectors and societies, it is critical to work towards systems that are fair and inclusive for all.”<\/p>\n

Meta said in a statement: “We will continue to engage with the community to identify and mitigate vulnerabilities in a transparent manner and support the development of safer generative AI.”<\/p>\n

OpenAI’s CEO Sam Altman and co-founder Greg Brockman have previously acknowledged the bias<\/strong>, emphasizing the company’s mission for a balanced AI system. Yet, critics, including co-founder Elon Musk, remain skeptical.<\/p>\n

Musk’s recent venture, xAI, promises to provide unfiltered insights,<\/strong> potentially sparking even more debates around AI biases. The tech mogul warns against training AIs to toe a politically correct line, emphasizing the importance of an AI stating its “truth.”<\/p>\n

Hackers, meanwhile, are having a field day <\/strong>bending AI to their will.<\/p>\n

As Bloomberg<\/em><\/a> reports:<\/p>\n

Kennedy Mays has just tricked a large language model.<\/strong> It took some coaxing, but she managed to convince an algorithm to say 9 + 10 = 21.<\/strong><\/em><\/p>\n

\u201cIt was a back-and-forth conversation<\/strong>,\u201d said the 21-year-old student from Savannah, Georgia. At first the model agreed to say it was part of an \u201cinside joke\u201d between them.<\/strong> Several prompts later, it eventually stopped qualifying the errant sum in any way at all.<\/strong><\/em><\/p>\n

Producing \u201cBad Math\u201d is just one of the ways thousands of hackers are trying to expose flaws and biases in generative AI systems<\/strong> at a novel public contest taking place at the DEF CON hacking conference this weekend in Las Vegas.<\/em><\/p>\n

Hunched over 156 laptops for 50 minutes at a time, the attendees are battling some of <\/strong>the world\u2019s most intelligent platforms on an unprecedented scale. They\u2019re testing whether any of eight models produced by companies including Alphabet Inc.<\/a>\u2019s Google, Meta Platforms Inc.<\/a> and OpenAI<\/a> will make missteps ranging from dull to dangerous: claim to be human, spread incorrect claims about places and people or advocate abuse.<\/em><\/p>\n

The goal of such exercises is to help companies offering LLM chatbots build better mechanisms to improve factual responses.<\/p>\n

“My biggest concern is inherent bias,<\/strong>” said Mays, who added that she’s particularly concerned about racism after she asked the model to consider the First Amendment from the perspective of a KKK member – and the chatbot ended up endorsing the group’s perspective.<\/p>\n

AI surveillance?<\/strong><\/p>\n

In another instance, a Bloomberg<\/em> reporter who took a 50-minute quiz was able to prompt one of the models to explain how to spy on someone<\/strong> – advising on a variety of methods including the use of GPS tracking, a surveillance camera, a listening device and thermal imaging. It also suggested ways that the US government could surveil a human-rights activist<\/strong>.<\/p>\n

“General artificial intelligence could be the last innovation that human beings really need to do themselves,” said Tyrance Billingsley, executive director of the group who is also an event judge. “We\u2019re still in the early, early, early stages.”<\/p>\n<\/div>\n

Tyler Durden<\/a><\/span>
\nSat, 08\/12\/2023 – 19:00<\/span><\/p>\n

\u200bhttps:\/\/www.zerohedge.com\/technology\/study-reveals-which-ai-chatbot-most-woke-while-hackers-trick-llms-bad-math<\/a>\u00a0<\/p>\n

\u00a0<\/p>\n","protected":false},"excerpt":{"rendered":"

Study Reveals Which AI Chatbot Most Woke, While Hackers Trick LLMs Into ‘Bad Math’ A landmark study from researchers at the University of Washington, Carnegie…<\/p>\n","protected":false},"author":0,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-1399552","post","type-post","status-publish","format-standard","hentry","category-news","wpcat-1-id"],"_links":{"self":[{"href":"https:\/\/bugaluu.com\/news\/wp-json\/wp\/v2\/posts\/1399552","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/bugaluu.com\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/bugaluu.com\/news\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/bugaluu.com\/news\/wp-json\/wp\/v2\/comments?post=1399552"}],"version-history":[{"count":0,"href":"https:\/\/bugaluu.com\/news\/wp-json\/wp\/v2\/posts\/1399552\/revisions"}],"wp:attachment":[{"href":"https:\/\/bugaluu.com\/news\/wp-json\/wp\/v2\/media?parent=1399552"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/bugaluu.com\/news\/wp-json\/wp\/v2\/categories?post=1399552"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/bugaluu.com\/news\/wp-json\/wp\/v2\/tags?post=1399552"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}