The Union

Generative AI is only 5%

Krista Software

The Pressing Demand for Generative AI in Enterprise

Generative AI (GenAI) is promising unparalleled advancements and efficiencies for many types of use cases.  Boards and CEOs continue to experiment with the technology and imagine how it can improve workforces and increase throughput. The Wall Street Journal highlights how CEOs are pressuring CIOs and technology leaders to urgently install generative AI for fear of being left behind and CIOs are feeling the heat. However, with the dynamics and complexity of adopting generative AI in enterprise settings, it becomes clear that managing expectations is just as important as it is about technological integration.

Generative AI Sets False Expectations

The simplicity and efficiency of generative AI in personal use often paint an unintentionally misleading picture in an enterprise setting. When CEOs and other non-technical leaders personally interact with tools like ChatGPT, they're introduced to the potential of the technology in an uncomplicated, straightforward context. This magical experience often sets false expectations, leading them to question why such technology isn't already integrated into the broader systems of their companies. However, the reality is that scaling these tools for enterprise needs is a vastly more intricate process. It's akin to the difference between cooking a meal for oneself versus catering for a large event with complex dietary restrictions; the underlying task is the same, but the scope and complexity are dramatically different. This lack of understanding between personal uses and the intricacies of enterprise deployment highlights the need for clearer communication about the capabilities and limitations of AI tools in a business context.
The Intricacies of Enterprise Implementation

Deploying generative AI in an enterprise setting is more than meets the eye. While individuals might find generative AI to be a convenient solution for isolated tasks, integrating it within a business's broader systems demands addressing a series of complex challenges. As John points out while a user might see generative AI as solving 100% of a personal problem, it only covers about 5% of the challenges in a business context. The vast majority of the work comes from:

  • Content ingestion: Importing data correctly is a massive challenge, especially when dealing with varied content like text, tables, images, and metadata. Properly importing, categorizing, and managing this data is a colossal task that requires precision to ensure you prompt an AI model with the right context and information.
  • Real-time access: Unlike personal use scenarios, where static data is sufficient, enterprises operate in dynamic environments and require real-time data, which means integrating AI models with existing systems in a nimble and adaptable method.
  • Data security:  Enterprises deal with vast amounts of sensitive data, and any AI model must operate securely within existing frameworks, ensuring that access is limited to only the appropriate roles and parties.
  • Scalability and cost: Experimenting with public interfaces is free or inexpensive but deploying these models at scale can be extremely costly so enterprises need to be able to manage these costs and justify the investments.

The journey towards integrating generative AI in your enterprise is simple if you plan effectively and leverage the right tools. It involves more than simple adoption—it demands understanding, strategic planning, careful deployment, and continuous assessment. With the right approach, clear use cases, strong data governance, skillful training, and vigilant monitoring, generative AI can be effectively integrated to drive considerable value to your business, fostering innovation, and giving your organization a competitive edge.


More at krista.ai

People on this episode