I am working in a regulated industry and I cannot send user data to a public cloud API. Does anyone have advice on how to build a generative workflow that stays strictly on-premises? I know about local LLMs, but what about the broader ecosystem of tools? Are there specific vector databases or agentic frameworks that are enterprise-ready for air-gapped environments? I feel like most of the tutorials online assume you have internet connectivity.
The question