How To Move From POC to ROI With AI Deployment
Seetharaman shared her company’s experience in developing AI capabilities, which highlighted some of the often-repeated struggles organizations encounter when attempting to derive a return on their AI investments: “Over the last decade or so, we have built and deployed many predictive AI applications. Over the years, we’ve had to build and scale generative AI applications, and we’re starting the crawl-walk-run journey for agentic tech.”
She said that TD Bank began its journey to agentic AI use cases about two years ago: “We spent a lot of time just getting the model stack working so that it could be applied practically in business context within the bank. We then spent about six to nine months building out the engineering infrastructure to take the model from a proof of concept all the way to production.”
During that time from POC to production, Seetharaman said, the organization learned a great deal, but it still needed to arrive at an ROI. “How do you drive the appropriate rigor and change management and adoption and value realization?” she asked. “And where we’re at now is, we’re realizing that these models deprecate really, really fast. So, the customer and colleague expectations evolved super fast. So, we’re learning the day-two rigor of how do we keep up, and how do we keep these models alive and fresh for our customers?”
READ MORE: How agentic artificial intelligence is changing the future of work and AI use cases.
Taking the Next Step to Agentic AI
Seematharan said she finds people are defining agentic AI in many different ways. “I find it’s a whole spectrum, starting from simple automation, rules-based decision making, to a low-autonomy sort of AI use, to very sophisticated, highly autonomous agentic AI. So, it seems to be a pretty broad spectrum.”
She described the AI journey at TD, beginning with simple automation and robotic process automation, which continued for many years. The bank then rolled out predictive AI applications to all banking operations, from marketing to credit adjudication. “We’re now rolling out colleague-facing GenAI applications across the bank, whether it's call center, or branch colleagues, or wealth operations, and so on. And we’re now starting to look at end-to-end process flows — whether they’re manual or semi-automated — and starting to think about, where can AI augment these workflows and drive sort of operational efficiency, unlock revenue generation opportunities?”
“Our GenAI journey shows that there is a lot of scaffolding that you need to build in order to run these applications in a reliable, predictable, consistent, explainable way,” Seetharaman continued. In her estimation, agentic AI only amps up the complexity further, which demands that the bank consider how to build agents responsibly before pushing forward too aggressively. “Let’s try to increase the degree of variability. Let’s try to increase the level of sophistication, autonomy, etc., so we’re building the groundwork and the scaffolding before we start to turn that dial.”
