OutcomesCouncilGeniusJargon
Sign inGet Ugenie

Your ask is AI’s task.

Get Ugenie

Ugenie

OutcomesCouncilGeniusJoin the waitlistContact

Legal

Terms of usePrivacy noticeCookie policy

Part of the V.ONE Venture Studio portfolio.

© 2026 Ugenie AI LTD (trading as “Ugenie”). Registered in England and Wales, company number 16331448. Registered office: Bartle House, 9 Oxford Court, Manchester, M2 3WQ, United Kingdom.

Get Ugenie
← All jargonJargon

Jargon:Transformer

1 min read

Tr

Say this at the party

“The design behind ChatGPT, Claude and Gemini. It reads a whole passage at once and works out which words matter most to each other.”

Hype meter: RealGenuinely the engine of modern AI.

In plain English

Older language AI read text one word at a time, like someone reading through a keyhole. By the end of a long sentence it had often lost track of the start.

A transformer looks at all the words together. For each word it asks "which other words here help me understand this one?" That trick is called attention.

It also turned out to be very good at using lots of computer chips at once, which is how models got so big so fast. It's the T in GPT.

Where it came from

Eight researchers at Google introduced it in June 2017 in a paper called "Attention Is All You Need". It was built to improve machine translation, then took over almost all of AI.

See it in action

In "the trophy didn't fit in the suitcase because it was too big", a transformer links "it" to "trophy" by weighing every word in the sentence against every other.

What people get wrong

  • Nothing to do with the robots in disguise, or the box on an electricity pole.
  • A transformer is a design, not a product. ChatGPT, Claude and Gemini are all different models built on the same basic design.

Go deeper

  • PaperVaswani et al., Google, 2017Attention Is All You NeedThe original paper. Possibly the most influential AI paper of the last decade.
  • GuideJay AlammarThe Illustrated TransformerA famous picture-by-picture walk through how a transformer works.
  • ArticleWikipediaTransformer (deep learning)History and detail, including the ideas that came just before it.

Related jargon

Context windowGenerative AILarge language model (LLM)Neural networkToken

Drafted with AI. The AI Council (Claude, ChatGPT and Gemini) gave counsel. Phin signed it off.

More jargon

  • AGE
    Jargon

    Jargon:Agentic growth engine (AGE)

    “A set of AI agents that keeps trying new ways to win customers, checks what worked and does more of it, with a person holding the budget.”

    Hype meter: Mostly hypeSound smart →
  • BA
    Jargon

    Jargon:Background agent

    “An AI you hand a job to and then walk away from. It works on its own computer somewhere else and lets you know when it's finished.”

    Hype meter: Mostly realSound smart →
  • PA
    Jargon

    Jargon:Parallel agents

    “Several AI helpers working at the same time, each on its own piece of a job or each having a go at the same one. Then the best work gets picked.”

    Hype meter: Mostly realSound smart →