Exploring the Edge of Enterprise AI: How Businesses are Leveraging Open Ecosystems and Small Models for Real-Time Processing

As enterprise AI continues to gain traction, businesses are faced with the challenge of assessing whether their existing architecture can support this technology. The initial hype surrounding AI in the public cloud has shifted towards investing in open ecosystems for AI and utilizing smaller models that can run at the edge of a business’s network. This shift has opened up a multitude of possibilities for using AI, from chatbots that can operate offline to AI managing data from sensors in smart manufacturing environments. However, the key question is where is the demand among customers for this technology, and how has their understanding of AI architecture evolved over the past year?

During a live recording at Dell Technologies World 2024, Rory discusses these changes with Dermot O’Connell, senior vice president for EMEA services at Dell Technologies. They explore different approaches to adopting enterprise AI and provide insights on how businesses can prepare themselves for this technological advancement.

Dermot emphasizes the importance of running AI applications at the edge and using containers to support modern applications in a modular way. This approach allows businesses to operate where the data is generated, reducing latency and enabling real-time processing. Despite the potential of AI at the edge, Dermot points out that many businesses are only scratching the surface in terms of utilizing this technology. Projects involving avatars, chatbots, and coding engines are just the beginning stages of what can be achieved with AI at the edge.

In order to ease the transition to AI adoption, Dermot suggests starting with small-scale projects that do not compromise data security. It is crucial for businesses to consider data governance and privacy concerns when implementing AI solutions. Additionally, he advises focusing on creating entry points for employees and customers to engage with AI technology. To stay informed about the latest updates in the industry, including insights on AI cyber crime and security