From the now-infamous Mother’s Day photo from Kensington Palace to faked audio of Tom Cruise disparaging the Olympic Committee, AI-generated content has made headlines recently for all the wrong reasons. These instances are sparking widespread controversy and paranoia, leaving people questioning the authenticity and origin of content they see online.
It’s impacting every corner of society, not only public figures and everyday internet users, but also the world's largest companies. Chase Bank, for instance, reported being fooled by a deepfake during an internal experiment. Meanwhile, a report revealed that in just one year, deepfake incidents skyrocketed in the fintech sector by 700%.
Today, there's a critical lack of transparency around AI, including whether an image, video, or voice was AI-generated or not. Efficient methods of auditing AI, which unlock a greater level of accountability and incentivizes companies to more aggressively root out misleading content, are still developing. These shortcomings combine to exacerbate the AI trust problem, and combating these challenges is contingent on bringing more clarity to AI models. It’s a primary hurdle for companies looking to tap into the massive value of AI tools but concerned the risk may outweigh the reward.
Right now, all eyes are on AI. But while the technology has experienced historic levels of innovation and investment, trust in AI and many of the companies behind the technology has steadily decreased. Not only is it becoming harder to distinguish human- and AI-generated content online, but business leaders are also growing wary of investing in their own AI systems. There’s a common struggle to ensure the benefits outweigh the risk, all compounded by murkiness around how the technology actually works. It’s often unclear what kind of data is being used to train models, how the data impacts generated outputs, and what the technology is doing with a company's proprietary data.
This lack of visibility presents a slew of legal and security risks for business leaders. Despite the fact that AI budgets are set to increase up to five times this year, rising cybersecurity concerns have reportedly led to 18.5% of all AI or ML transactions in the enterprise being blocked. That’s a whopping 577% increase in just nine months, with the highest instance of this (37.16%) being in finance and insurance — industries that have especially strict security and legal requirements. Finance and insurance represent harbingers of what could come in other industries as questions around AI's security and legal risks grow and businesses have to consider the implications of using the technology.
Even while itching to tap into the $15.7 trillion in value AI could unlock by 2030, it’s clear that enterprises can’t fully trust AI right now, and this roadblock could only grow worse if issues aren’t addressed. There’s a pressing need to introduce greater transparency to AI to make it easier to determine when content is AI-generated or not, to see how AI systems are using data, and to better understand outputs. The big question lies in how this is accomplished. Transparency and waning AI trust are complex problems that don’t have a single smoking gun solution, and progress will require collaboration from sectors around the globe.
Luckily, we’ve already seen signs that both government and technology leaders are focused on addressing the issue. The recent EU AI Act is an important first step in setting regulatory guidelines and requirements around responsible AI deployment, and in the U.S., states like California have taken steps to introduce their own legislation.