What an agent actually is (and isn't)
Cut through the marketing. Define agents by behavior, not hype.
"Agent" is the most overloaded word in AI. Strip the hype: an agent is software where a language model decides, in a loop, what to do next.
The minimum viable definition
An agent is a system with:
- A goal (often specified per-invocation).
- A set of actions it can take (tools, APIs, code execution, human messaging).
- A loop where the LLM picks the next action, observes the result, and decides again.
Everything else — planning, memory, multi-agent coordination — is optimization of that core loop.
Why the word gets abused
"Agentic" gets slapped on any software that uses an LLM. A chatbot isn't an agent. A single-turn summarizer isn't an agent. A workflow with one LLM call in the middle isn't an agent. A loop makes it an agent.
The three failure modes of the loop
Every agent failure looks like one of these:
- Wrong next action. The model chose a tool that doesn't get closer to the goal. Root cause: ambiguous tool descriptions or missing context.
- Infinite loop. The model keeps trying the same thing. Root cause: poor error handling — the model doesn't learn from failed tool calls.
- Premature termination. The model declares success when the goal isn't met. Root cause: no verification step.
Most of agent engineering is mitigating these three.
What agents are good at (honestly, in 2026)
- Multi-step information gathering. "Research X and produce a brief." Strong.
- Software engineering on bounded tasks. Open a PR to fix a well-specified bug. Getting strong.
- Customer support triage and partial resolution. Strong for common flows, weak at edge cases.
- Web navigation for well-defined transactions. "Book this for me" is still error-prone; "find me three options and summarize" is solid.
What agents are still bad at
- Tasks requiring stable long-term memory across many sessions.
- Anything with high stakes per action (financial transactions, medical orders, irreversible data operations) without heavy human oversight.
- Novel tasks with no precedent in training. The loop doesn't magically invent new methods.
The designer's job
When you build an agent, your job is:
- Make the goal specific enough to verify.
- Make the tools few and well-described.
- Make the loop safe — able to recover from failures, able to ask for help, able to stop.
Give a model a vague goal and a bag of tools and you get a demo. Give it a precise goal and three reliable tools and you get something that ships.
Check your understanding
2-question self-check
Optional. Your answers feed your knowledge score on the track certificate.
Q1.By the lesson's definition, what separates an agent from a chatbot or single-call AI feature?
Q2.Which is NOT one of the three canonical agent failure modes the lesson names?
Continue in this track
More lessons from Building AI Agents.
Lesson 2
Tool use: giving a model hands
How tool calling works under the hood, and how to design tools models can use.
Lesson 3
Memory systems: short, long, and associative
The three kinds of memory an agent needs and how to build each.
Lesson 4
Planning strategies: ReAct, Plan-and-Execute, and beyond
Different shapes of agent reasoning and when to use each.