What is Chat GPT AI/ML?

What is Chat GPT AI/ML?  AI/ML—short for artificial intelligence (AI) and machine learning (ML)—represents an important evolution in computer science and data processing that is quickly transforming a vast array of industries.

As businesses and other organizations undergo digital transformation, they’re faced with a growing tsunami of data that is at once incredibly valuable and increasingly burdensome to collect, process and analyze.

New tools and methodologies are needed to manage the vast quantity of data being collected, to mine it for insights and to act on those insights when they’re discovered.

Are we at an inflection point on the road to developing more innovative AI/ML techniques, such as large language models (LLM) and related software? All the hype around ChatGPT and the subsequent announcements of similar products and massive investments by competitors suggest we are at the beginning of many exciting advances.

On the other hand, if you ignore the hype, is ChatGPT just one of many incremental steps that have occurred without fanfare during the past several years? Perhaps the only difference between the ChatGPT step and its predecessors is it’s a well-promoted step.

I believe ChatGPT and its peers are a significant AI/ML advance. Even more important, we are at the beginning of many exciting AI/ML advances. What will the next generation of LLMs look like? What should CIOs consider as they evaluate the potential of AI/ML advances for applications that can help their organizations? Here are the emerging advances.

Models will generate their own training data to improve themselves – What is Chat GPT AI/ML?

Today’s LLMs are limited to processing the information their software has derived from scraping the web. It’s tempting to conclude that the web contains all the information there is or is needed to process LLM queries. However, that’s not true. For example:

  1. A lot of information sits behind a login screen, making it unavailable for scraping.
  2. A considerable amount of historical information exists only on paper in off-site storage boxes.
  3. Some literature, government documents and business information exists only on paper.
  4. Small amounts of information exist only as artifacts in museums.

Emerging LLMs are developing techniques to enhance their training data and thereby compensate for these gaps. For example:

  1. Some emerging LLMs can further process their answers to augment their training data to improve their subsequent query accuracy.
  2. Another emerging LLM method replaces the current manual fine-tuning of models with more advanced models that can generate their own natural language fine-tuning instructions.
  3. At least one research group asks the LLM model to reflect on its answer and refine it before presenting it.

This ability to generate their own training data will produce an enormous leap forward in the accuracy of LLMs’ output.

Models will fact-check themselves to reduce inaccuracies – What is Chat GPT AI/ML?

Today’s LLMs regularly produce inaccurate, misleading or false output, even though they display it confidently. Researchers call such output “hallucinations.” This problem exists because the training data from the web includes innocent mistakes and deliberate misinformation.

Currently, LLMs:

  1. Are limited to the information their software derived previously from scraping the web up to a cut-off date selected by the LLM developer.
  2. Cannot access data from anywhere in real-time to answer queries.

Emerging LLMs are developing the ability to:

  1. Provide references and citations to support the accuracy of their output.
  2. Demonstrate that their output is based on credible sources.
  3. Submit queries to a search engine and then base their output on its results.

These developments will increase confidence in LLM output and overcome the current risk of unreliability.

Models will become sparser to improve performance – What is Chat GPT AI/ML?

Today’s LLMs all use a surprisingly similar architecture, including dense models. Dense means that the model processes all of its many billions of parameters for every query.

As the value of size, or the number of parameters, has become apparent, LLMs have become larger and consume more computing resources to respond to queries. These factors have increased costs, caused congestion and decreased response times. To counteract these undesirable outcomes, the idea of sparse models has emerged.

Emerging LLMs divide their parameters into subject domains to create sparse models or multiple sub-models. LLMs then process just the sub-model parameters corresponding to the query’s domain.

The further development of sparse models will support LLMs with an increasing number of parameters while being less consumptive of computing resources.

Models will learn more about reasoning to become smarter – What is Chat GPT AI/ML?

Today’s LLMs have achieved excellent performance for various tasks. However, LLMs:

  1. Have no awareness of the meaning of their output.
  2. Require extensive supervision effort to fine-tune their output.
  3. Respond poorly to queries that require reasoning, common sense, and implicitly learned skills.

Humans operate differently. We read various sources of information and then reflect on the topic or think through a problem. Unlike humans, LLMs cannot generate novel ideas and insights from data.

Emerging LLMs improve their performance by self-evaluating multiple reasoning paths available to produce the query output. Two of these reasoning paths are called “chain-of-thought (CoT)” and “zero-shot chain-of-thought.” They are invoked with a “Let’s think step by step” prompt. The benefit of these techniques is that they improve the accuracy of LLM output without requiring enhancements to the LLM.

While no one is suggesting that this small change produces LLMs that learn, this technique is a small step toward the goal of LLMs that can reason. We can expect more progress as research continues.

Models will run on purpose-built chips to become faster – What is Chat GPT AI/ML?

Today’s LLMs run on large server farms with general-purpose high-performance CPUs and attached graphics processing units (GPUs). Critical features of high-performance servers that can handle the voracious appetite for computing resources that LLMs exhibit include:

  1. Multiple PCI-Express lanes to connect CPUs to GPUs.
  2. Multiple channels between the memory and each CPU.

Continuing developments in hardware that will improve LLM performance even as their demands for computing resources increase include:

  1. GPUs with increased capacity and performance with modest increases in cooling requirements and physical size.
  2. GPUs with increased video random access memory (VRAM) for improved image processing.
  3. Field-programmable gate arrays (FPGA) containing configurable programmable logic blocks that can accelerate the processing of the most prevalent instructions in AI/ML applications.
  4. Custom-designed application-specific integrated circuits (ASICs) for the matrix computations that AI/ML uses intensely.
  5. Links between GPUs to reduce CPU load.
  6. Higher performance storage systems such as fast NVMe drives to minimize data access elapsed time.

Related Posts:

The Memory Game VB.NET setup install package(Opens in a new browser tab)

AI machine learning and deep learning: Everything you need to know(Opens in a new browser tab)

Talking to Your Computer(Opens in a new browser tab)

Introduction to JavaScript – Built-in Methods(Opens in a new browser tab)

Relevanssi – A Better Search – By Mikko Saari(Opens in a new browser tab)


Connected through code, Choose Your Platform!

About the Author: Bernard Aybout

In the land of bytes and bits, a father of three sits, With a heart for tech and coding kits, in IT he never quits. At Magna's door, he took his stance, in Canada's wide expanse, At Karmax Heavy Stamping - Cosma's dance, he gave his career a chance. With a passion deep for teaching code, to the young minds he showed, The path where digital seeds are sowed, in critical thinking mode. But alas, not all was bright and fair, at Magna's lair, oh despair, Harassment, intimidation, a chilling air, made the workplace hard to bear. Management's maze and morale's dip, made our hero's spirit flip, In a demoralizing grip, his well-being began to slip. So he bid adieu to Magna's scene, from the division not so serene, Yet in tech, his interest keen, continues to inspire and convene.