We're Building a Generative AI System Solution with IBM

New solution intended to help enterprises seeking to better manage training data for generative AI systems across organizations

Prove AI and IBM (NYSE: IBM) Consulting today announced they will work to help clients leverage blockchain to gain greater transparency and audibility in their AI systems. Together, Prove AI and IBM Consulting plan to develop a new Prove AI solution, designed with blockchain and built leveraging IBM watsonx.governance, that establishes an additional analytics and policy enforcement layer for governing AI training data across organizations.

The process of training, developing and deploying generative AI models happens across multiple organizations, from the original model creator to the end user organization. As different organizations integrate new data sets or modify the models, their outputs change accordingly, and many organizations need to be able to track and audit those changes as well as accurately diagnose and remediate issues. Blockchain can help organizations share their trusted context information via metadata in the ledger documenting that the models have changed while mitigating the risk of intellectual property crossover or unnecessary data sharing across organizational lines.

Prove AI's solution is exclusively built on the Hedera blockchain, a tamper-resistant and highly serialized ledger, and leverages IBM watsonx.governance and watsonx.ai to monitor and measure highly serialized input and output data for training generative AI systems across organizations. Thanks to the Hedera network, organizations can expect to be able to better protect sensitive data stored in the solution from being accessible to external actors; they have control over who can access what data. The solution will also be built to support version control using the serialization capabilities of blockchain, so organizations can efficiently revert to previous iterations of an AI system if performance issues or biased outputs occur.

IBM Consulting’s AI governance and technology experts will assist us in building the solution, which we expect to be available for clients in beta in first quarter 2024 and later available more broadly in their channels and in the IBM Cloud Marketplace.

“An AI system’s efficacy is ultimately as good as an organization’s ability to govern it,” said Shyam Nagarajan, Global Partner, Blockchain and Responsible AI Leader at IBM Consulting. “Companies need solutions that foster trust, enhance explainability, and mitigate risk. We’re proud to bring IBM Consulting and technology to support us in creating a new solution offering an important layer to drive transparency and risk mitigation for companies deploying AI at scale.”

The new solution is planned to help companies across industries, including financial services, healthcare, and retail, deploy AI responsibly at scale across their ecosystem of technology and services providers. Among other features, the solution aims to offer:

Compliance Dashboard: A centralized dashboard for monitoring and managing AI systems as they’re applied across organizations to support their compliance processes with an organization’s ethical guidelines.
Quality Control Toolkit: Tools for monitoring the quality and performance of AI systems, along with an interface to enhance the transparency and explainability of AI outputs.
Version Control: The ability to correct for performance or other issues by “rolling back” to previous iterations of a given AI system that didn’t display issues.
Audit and Reporting System: A system for auditing AI processes and generating detailed reports based on context metadata captured by our ledger.

“While generative AI has justifiably excited organizations for its transformative potential, its practical applications have been severely limited by an inability to monitor and react to the data feeding AI systems,” said Mrinal Manohar, CEO at Prove AI. “With IBM’s help, we’re committed to delivering a better way to not only understand why AI systems behave the way that they do but also a clearer path to remediate behavior if hallucinations or performance issues occur. AI’s long-term potential will be dictated by how effectively and efficiently organizations can understand, govern and react to increasingly massive AI training data sets.”

Casper Labs and IBM Consulting to Demonstrate AI Governance Solution in Davos

On Tuesday, January 16, Mrinal Manohar and Shyam Nagarajan will preview this solution during a live session at The Hub in Davos. To register for that session, visit thehubdavos.com.