Choosing the right AI product is one of the hardest decisions for any CIO. At Jamf, it’s been a top priority as we roll out automation across the business.

Amid the endless AI hype, many leaders assume it will elevate their business. However, choosing the wrong tool can be disastrous, both operationally and from a security perspective.

As a CIO, I’m acutely aware that I only get one or two chances to implement a technology correctly. If I fail to get it right the first time, the project is likely to be cancelled, and precious budget wasted.

Know what you’re trying to achieve

Before you even start looking at AI products, CIOs must define what they want to achieve. AI is all the rage, especially regarding productivity gains. However, that doesn’t guarantee value. CIOs must apply the same principles to AI as they would to buying any technology.

I saw the same with early cloud adoption, and many businesses still feel the pain of those rushed decisions.

At Jamf, our goal was clear: automate and transform processes and improve productivity. If an AI solution cannot map to one of these drivers, it may not be the best fit.

Another crucial factor was security. As a security company, our ability to securely handle sensitive data is central to our reputation. Any AI product requiring access to sensitive data to train its own models are an absolute no-go.

Establishing clear objectives from the outset helps cut through the hype and justify yes or no decisions. For example, leadership often return from events excited about new AI tools, asking what we have in place and what we can invest in next.

With defined objectives, it's easy for me to explain why certain AI products fit our strategy while others don’t. My answer to employees is centred on explaining our automation journey, which started long before GenAI became popular. Any new AI tool must align with that vision.

How to distinguish between hype and value

Saying there are a lot of AI products out there would be an understatement. As of 2024, there are approximately 70,000 AI companies worldwide—on top of all the other household tech companies now offering AI-powered solutions.

There’s a lot of noise in the market, and I see this every day in my inbox. I get hundreds of unsolicited AI product emails daily, making it impossible to keep track.

If a sales pitch does catch my attention, I turn to my industry network. CIOs shouldn’t hesitate to call and speak with other CIOs about their experiences with a particular product.

I’m part of trusted forums and groups with many other CIOs, where I often ask if anyone has heard of a specific AI product and what their thoughts are. One or two replies is usually enough to shape how I respond to vendors

If no CIO in the forum replies, that’s not necessarily a bad sign—it could just mean the company is a new AI startup. However, this is where extra due diligence becomes critical. If you’re interested in a product, that’s great, but make sure to ask the right questions before making a purchase.

The questions CIOs must ask

As I mentioned before, buying AI is similar to buying any other technology—the same rules still apply.

The first thing I usually ask for is use cases from companies comparable to Jamf’s profile. I need to know how other publicly listed and security companies have fared when implementing the tool. If the vendor can’t provide such details, then I can’t be confident that the tool’s value is real.

Cost versus value is crucial. As CIO, I manage the IT budget while ensuring technology delivers value. If I overspend without clear value from an AI solution, I’m not doing my job right.

CIOs should inquire about both implementation and ongoing support costs. Are there support tiers? What are their costs? Will extra staff be needed to maintain and train the AI? AI often has overlooked ongoing costs after implementation.

CIOs must know what data an AI tool is trained on and what it needs from their company. Be wary of tools that require access to financial, customer, employee, revenue, or code data. A company’s reputation depends on data security, and CIOs shouldn’t compromise—AI is no exception.

For me, there must be an extremely good reason for the tool to require this data, and I need to understand the security mechanisms in place to ensure sensitive information is not put at risk. An unconvincing answer here almost certainly means no sale.

Understanding the art of buying GenAI

The AI landscape is evolving faster than ever. CIOs should embrace the innovation AI offers and adapt quickly. However, like any technology, buying AI products should focus on long-term success. Throughout the process, ask yourself: will this product contribute to that success?

You’ll have people telling you that you must buy this latest AI product—I can’t count the number of times this has happened to me. However, I stayed focused on my core objectives, made sure I understood the value the product would bring, and never compromised on our business vision.

Linh Lam CIO Jamf