However, trust in agent AI is increasing. OutSystems reports that 73% of respondents expressed high or moderate trust in agents’ autonomous behavior, an increase of about 10% compared to a similar survey the company conducted last year. Trust in code and workflows generated by third-party AI tools was slightly lower at 67%, a significant increase from a year ago, when just 40% said they “mostly trust” generative AI that can write code without human assistance.
Only 36% said they had a centralized approach to AI governance, 64% said they did not have such a capability, and 41% relied on rules put in place on a project-by-project basis. Two-thirds say building human-involved checkpoints is technically difficult. The reason is that you need an orchestration that can pause the agent, effectively inserting a hand brake into an operation that could be completely autonomous.
Many organizations appear to be adopting a looser monitoring model, but it’s unclear whether this is a result of increased trust in the model or whether business functions are under pressure to adopt AI regardless of security and reliability concerns. If trends toward less oversight continue, the report’s authors say the adoption of agent-based AI could outpace the accountability measures that many believe are important.
Companies that want to scale agents in regulated or mission-critical environments need to treat orchestration and auditability as part of their offering, the study says. When compliance checks consider enterprise operations, breadcrumbs in the form of log files and defined responsibilities are considered key elements of agent AI deployment.
According to the report, 94% of leaders are concerned about “AI sprawl.” Although this is not defined, we can assume that it is the lack of a central management platform to oversee all AI deployments within the enterprise. 39% are very or extremely concerned about this issue, and only 12% are currently using centralized platforms to control its spread.
The full study can be accessed here.
(Image source: “Relax” by Koijots is licensed under CC BY-SA 2.0. To view a copy of this license, please visit https://creativecommons.org/licenses/by-sa/2.0)
Want to learn more about AI and big data from industry leaders? Check out the AI & Big Data Expos in Amsterdam, California, and London. This comprehensive event is part of TechEx and co-located with other major technology events. Click here for more information.
AI News is brought to you by TechForge Media. Learn about other upcoming enterprise technology events and webinars.
