ChatGPT | Generative AI Glossary

Struggling to wade your way throught all the AI technology jargon? We’re here to help you. Below you can find a series of definitions related to Generative AI & ChatGPT.

ChatGPT

  • ChatGPT (Chat Generative Pre-trained Transformer) is an intelligent chatbot that helps automate dialogue responses. The chatbot applies machine learning algorithms and is a GPT3 and GPT 3.5-based large language model.

InstructGPT

  • InstructGPT is a sibling model to GPT-3, which was developed by fine-tuning the GPT-3 model using reinforcement learning from human feedback. this means that Instruct GPT models are trained with humans in the loop, who ranked the output of the model. The result was a model that is better at following instructions and a reduction in toxic output.

Generative Artificial Intelligence

  • Generative Aritifical Intelligence is an umbrella term that’s used to describe any form of artificial intelligence system that relies on unsupervised or semi-supervised learning algorithms to create new digital images, vide, audio, text or code.

Generative Pre-trained Transformer

  • A Generative Pre-Trained Transformer (GPT) is a language model relying on deep learning that can generate human-like texts based on a given text-based input. GPT-3 is the third generation of Generative Pre-Trained Transformer that can create coherent responses using publically available datasets in response to a user input.

Supervised Learning

  • Supervised learning is a subcategory of machine learning and artifical intelligence. This type of machine learning involves training using ‘labelled’ training data, meaning some of the input data is already tagged with the correct output.

Reinforcement Learning

  • Reinforcement learning is the field of machine learning concerned with the science of decision making. The training method used in reinforcement learning is based on rewarding desired behaviours or punishing undesired ones.

Open AI

  •  OpenAI is an Artificial Intelligence (AI) research laboratory and company based in San Francisco, California. The company was founded by Elon Musk and Sam Altman in 2015. Open AI’s mission is to develop safe artificial intelligence for the benefit of humanity.

Machine Learning

  • Machine learning is the branch of artificial intelligence enabling systems to learn and improve from experience. Machine learning involves the construction of algorithms that adapt their models to improve their ability to make predictions without being explicity programmed.

Neural Network

  • Neural networks are a series of algorithms that mimic the human brain through interconnected nodes in a layered structure. Neural networks are used in artificial intelligence to recognise relationships between vast amounts of data in a type of machine learning called deep learning.

Language Modelling

  • Language Modelling (LM) is the use of probabilistic techniques to determine the probability of a sequence of words in the language.

Deep Learning

  • Deep learning is a type of machine learning that uses artificial multilayerd neural networks to learn large volumes of data. Deep learning drives many AI applications and services that improve automation, performing analytical and physical tasks without human intervention.

Natural Language Generation

  • Natural language generation (NLG) is the use of artificial intelligence programming to generate natural language such as written or spoken narratives from a data set. NLG software transforms data into language using AI models powered by machine learning and deep learning.

Natural Language Processing

  • Natural langauge processing (NLP) is the branch of artificial intelligence concerned with helping machines understand text and spoken words so that they can automatically perform repetitive tasks. Examples of NLP include machine translation, ticket classification and spell check.

Stable Diffusion

  • Stable diffusion is a deep learning, text-to-image model released in 2022, used to generate photorealistic images by using text descriptions. Stable Diffusion says its mission is to democratise AI capabilities, and the code underlying the model is available as an open source.