Secret to Building Killer ChatGPT Biz Apps is Traditional AI

In the nine months since ChatGPT’s debut dazzled the public and news media, the technology has yet to establish much of a beachhead in business. Chatbots aren’t new to business and the development of any significant new business applications built on the back of the impressive chatbot are conspicuously missing.

OpenAI, the organization that built ChatGPT, a generative AI that depends on large language models to create human sounding conversation, released an enterprise-grade version of ChatGPT on August 28. It was the company’s largest release since the lightning strike introduction of ChatGPT. The company obviously seeks to make the technology more appealing to business. But, what’s become clear to many working in AI is that one of the more promising ways to turn generative AI models into the juggernaut business tools many predicted they would become, is by pairing them with their more time-tested cousin: predictive AI.

Predictive AI, also known as traditional AI, has for years been the go-to AI for business. Predictive AI helps Uber offer real-time dynamic pricing and assists Netflix with recommending movies to subscribers. The model enables Progressive to improve risk analysis and offer lower insurance rates to safe drivers.

Both generative AI and predictive AI use machine learning, but the two models solve two very different classes of problems. Predictive AI relies on statistical algorithms to analyze data, identify patterns, and then make predictions about future events. The technology doesn’t create anything it hasn’t been programmed to create. In contrast, generative AI finds patterns in datasets and then recreates structure or style from within a wide variety of content, including video, text, and spoken language. In short, generative AI is trained on existing data and generates new content based on its learned knowledge.

During the past decade, companies spent billions on predictive AI research, building engineering teams, and refining tools. All the infrastructure, services, and knowhow that generative AI needs to make a splash in the business world exists within predictive AI’s ecosystem. The amount of innovative apps that might be created by uniting the best capabilities of these two AI seems endless.

For starters, predictive AI tools and techniques could help raise the quality level of the prompts that direct language model applications, such as ChatGPT. Predictive AI enables the integration of real-time data into consumer-facing and personalized applications. An app could receive prompts from human users in addition to prompts derived from real-time data sources. This would lead to more informed and illuminating responses.

Consider the possibility of training a chatbot to gauge and react to the changes in customer sentiment. Merchants have learned that understanding a customer’s satisfaction level can help them influence buying decisions. Say, for example, that a retail customer grows increasingly frustrated during an exchange with a chatbot. The bot could alert a human support agent, and then the agent might save the customer relationship or sale. If the customer’s mood brightens while interacting with a bot, the company and the bot could learn more about pleasing customers and adopt more impactful policies.

For generative AI to make further strides into real-time, customer-facing applications, it will need to make use of new and established tools and practices — LangChain and feature stores among them.

LangChain, one of the year’s most popular development frameworks, simplifies the building of Large Language Models, a generative AI designed to reason in a similar way to humans. LangChain connects AI models to key data sources, including feature stores, and also enables the creation of templates for LLM prompts. LangChain then populates the templates with external data and enables the retrieval of values.

In machine learning, a feature is a measurable piece of data or property of an event or phenomenon. This data may include names, ages, the number of purchases, or visits to an online store. Perhaps the best example of a feature is any dataset column.

Feature stores centralize the storing and organizing of features. These pre-engineered features either help train models or are used to make real-time predictions. Data-science teams re-use features to save themselves the hassle and cost involved with engineering features from scratch.

The importance of feeding real-time data into AI models can’t be overstated. Just like with humans, LLMs make better decisions when they have access to the most up-to-date and accurate data.

Certainly, AI is still in its infancy as a business application. It’s important to remember that no matter what transpires between generative AI and predictive AI, there is no road forward without making available to both models the highest-quality data.

Data makes all forms of AI possible.

It’s also important to note that the many media stories that followed the introduction of ChatGPT, the ones that featured headlines with some version of “Predictive AI vs. Generative AI,” missed the mark. It’s not a competition or zero-sum game.

On the contrary. These AI are different types of machine learning but they have the potential, if fused together in imaginative ways, to create exciting and innovative applications.