Adaptive AI agent infrastructure for data driven business operation to create custom adaptive gen-AI agents to optimize business operations