Prove AI | News + Press

AI Has a Trust Problem. Can Blockchain Help?

Written by Isabelle Bousquette | Jan 11, 2024

The difficulty of ensuring artificial intelligence algorithms are safe, unbiased and accurate is turning some companies to a technology once hyped as transformative, but that has failed to catch on in business: blockchain.

Known for underpinning bitcoin and other cryptocurrencies, blockchain is a data structure that makes it possible to create a digital ledger of transactions and share it among a network of computers. It uses cryptography to allow each participant in the network to add to the ledger in a secure way without the need for a central authority. Once a transaction is made, the blockchain remains an immutable record of it.

With that in mind, tech vendors FICO, a data-analytics firm, and the blockchain-focused startup Casper Labs say they are applying the technology to track the process of building and training AI algorithms.

It’s a timely and urgent application, they say, as AI proliferates across business sectors and companies find they can’t always trust its output. At the same time, government regulators are putting more pressure on companies to increase transparency and auditability of the algorithms.

Previous business uses of blockchain, including supply-chain tracking, failed to gain traction in the market. Whether the massive uptake in AI can be the wind under blockchain’s wings has yet to be determined.

Blockchain can be used to track exactly what data an algorithm was trained on, when, by whom, as well as what other steps were taken to vet and verify that data, said Scott Zoldi, FICO’s chief analytics officer. Companies building AI models typically try to follow that data trail, but using blockchain would make it easier to end up with shared, consistent, trustworthy records, he said. 

Blockchain won’t stop algorithms from going off the rails or exhibiting bias—but it would offer an auditable record that could show why, he said.

“We find that the blockchain can break things down into bite-sized little mini-contracts. We can validate that each of those steps are done at a very high-grain level,” Zoldi said. “There’s a level of transparency and honesty in having that immutability.”

Blockchain isn’t the answer to explainability, or the “black-box” problem in AI models. On its own, it won’t determine why an AI model spit out a particular answer. What it does promise are better records to help answer that question, Zoldi said.

Some CIOs are skeptical. “We’re all for greater AI governance, but using blockchain is a little like a hammer looking for a nail,” said Scott duFour, chief information officer of payments company Fleetcor Technologies. Blockchain could help increase trust in AI systems, he said, but only if it complemented other tools already in use that help designers understand and interpret predictions in AI models.

At present, FICO’s tool is being used internally, but there are plans to roll it out for customers later this year.

Elsewhere, Switzerland-based Casper Labs is working with IBM to develop its own tool which will offer “version control”: It records what data and parameters are influencing a certain model at a certain time and if companies start detecting bias or inaccuracies in their models, they can revert to an earlier version, said Chief Executive Mrinal Manohar.

Correcting bias in algorithms remains a difficult, time-consuming process and companies often lack the systems and tools to do it. 

Casper’s tool, currently in beta testing, is expected to hit the market as an integration with IBM’s watsonx AI governance platform in the third quarter of this year, though it won’t be exclusive to the watsonx platform, Manohar said. AI governance platforms attempt to guide the use of the technology and manage the risks associated with it.

The Morning Download delivers daily insights and news on business technology from the CIO Journal team.

 

Manohar said this use of blockchain is less prone to the problems that plagued earlier uses. In supply-chain tracking, for instance, companies already had longstanding, established methods of following their goods, and switching to an expensive, complex blockchain was a hard sell. But in AI governance, no such established methods exist, giving blockchain the rare opportunity to become an industry standard, Manohar said.

Supply-chain efforts also sputtered due to the large number of vendors and parties with varying levels of the tech-savvy needed to be involved in tracking. But fewer participants are needed here, said Avivah Litan, vice president and distinguished analyst at research and consulting firm Gartner.

Even so, that doesn’t mean the use of blockchain in AI governance is ready to take off.

“It’s a great idea, I just think it’s ahead of the market,” Litan said. Many companies haven’t historically prioritized AI governance and risk management as they work through new projects, she noted.

“On a scale of one to 10, it’s probably number three in importance for clients,” she said, though she added that it’s starting to creep higher as the number of generative AI projects mushrooms.

Manohar said he disagreed that the tool is ahead of the market and said he’s received a positive response from corporate tech leaders who’ve tested the tool.

“If companies aren’t prioritizing AI governance and risk management today, I’d argue it’s because most don’t know where to begin, not because they don’t care or don’t think it will become a priority,” he said.

Nicolás Ávila, chief technology officer for North America of software company Globant, said he feels the tools still need to prove themselves. He does, however, see great value in the convergence of the two technologies.

Ultimately, “AI is going to solve the problems of blockchain and blockchain is going to solve the problems of AI,” he said.