Skip to content

Guide · Agent skill

How to use the Check Understanding quiz agent skill

Updated · written with AI from the project's own documentation and checked against our catalogue data

Check Understanding is an agent skill for the AI Engineering from Scratch course. You name a phase, and your AI agent writes an 8-question multiple-choice quiz from that phase's lesson material, asks the questions one at a time, and then scores your answers. This guide explains what the skill does, how to install it, how to start a quiz with a plain request, and what it needs to run.

Check Understanding Quizrohitg00/ai-engineering-from-scratch · MIT

Quick start

  1. 1Download the ZIP. Get the Check Understanding ZIP file from this page.
  2. 2Install the skill. Unzip it into ~/.claude/skills/ or a project's .claude/skills/ folder, or upload it under Settings → Capabilities → Skills in the Claude apps.
  3. 3Make the course available. Clone the AI Engineering from Scratch repository locally, or make sure your agent can access GitHub.
  4. 4Ask for a quiz. Say 'quiz me on phase 2' or type /check-understanding followed by a phase number or name.
  5. 5Answer and review. Reply to each question with one letter, then review the lessons linked to any answers you missed.

What the skill makes your agent do

An agent skill is a set of instructions, stored in a SKILL.md file, that tells an AI agent how to handle a specific task. This one turns your agent into a quiz master for the AI Engineering from Scratch course.

You choose a phase from 0 to 19. The agent reads that phase's lesson material, writes 8 multiple-choice questions based on it, and asks them one by one. At the end it gives you a score and points you back to the lessons behind any questions you missed.

  • Questions 1-4 test concepts and reasoning (what and why).
  • Questions 5-8 test applied knowledge (how and build).
  • Each question has four options, A to D, with one correct answer.
  • Because the questions come from the course files, they match what you studied.

How do you install the Check Understanding skill?

Download the ZIP file for this skill from this page. Then install it using one of the two methods below.

For Claude Code, unzip the file into your personal skills folder at ~/.claude/skills/, or into a project's .claude/skills/ folder if you want the skill available only in that project.

In the Claude apps, upload the skill under Settings → Capabilities → Skills.

  • Personal install: unzip into ~/.claude/skills/
  • Project install: unzip into .claude/skills/ inside your project
  • Claude apps: Settings → Capabilities → Skills, then upload

How do you start a quiz with a natural request?

You do not need a special command. The skill activates on phrases such as 'quiz me on phase 2', 'test phase 1', 'do I know phase 3', 'check my understanding of transformers', and 'am I ready for the next phase'.

You can also use the slash form with a phase number or a phase name. A phase name such as deep-learning or transformers works as well as a number.

  • 'quiz me on phase 2'
  • 'test phase 1'
  • 'do I know phase 3'
  • 'check my understanding of transformers'
  • 'am I ready for the next phase'
/check-understanding 3

Which phases can you choose and how do you name them?

The course has 20 phases, numbered 0 to 19. You can type the number or a keyword from the phase map. For example, 0, setup or tooling all select Setup & Tooling, and 14, agents or agent-engineering all select Agent Engineering.

If you give no phase, the agent lists all 20 phases and asks you to pick one. If you give a number outside 0-19, or a keyword that does not match, the agent says so and shows the full list.

  • 0, setup, tooling: Setup & Tooling
  • 3, deep-learning, dl: Deep Learning Core
  • 7, transformers: Transformers Deep Dive
  • 10, llms, llm: LLMs from Scratch
  • 18, ethics, safety, alignment: Ethics, Safety & Alignment

How does a quiz session work?

The agent asks one question at a time and waits for your reply before moving on. Each question shows which lesson it comes from. Reply with a single letter for the option you choose.

After all 8 questions, you get a grade based on your score. The grades are Mastered for 7-8 correct, Almost for 5-6, Developing for 3-4, and Start Over for 0-2. For each wrong answer, the agent shows your answer, the correct answer, a short explanation and the lesson file to review. At the end you can retake the quiz, try another phase, or ask for an explanation of a topic you missed.

  • Score 7-8: Mastered
  • Score 5-6: Almost, with specific lessons to review
  • Score 3-4: Developing, with each missed question and its lesson
  • Score 0-2: Start Over, with all missed topics listed

What does the skill need, and what should you know about safety?

The skill needs an agent that supports SKILL.md skills and interactive prompts. It also needs the course content. You can either have the course repository cloned on your computer, or allow the agent internet access so it can fetch the course README and lesson files from GitHub.

This skill does not run scripts. It does use the network when the course repository is not cloned, because it then reads files from GitHub.

  • Requires: the course repository cloned locally, or internet access to read the README and lesson files from GitHub
  • Requires: an agent that supports SKILL.md skills and interactive prompts
  • Runs scripts: no
  • Uses network: yes

Tips for getting the most from the quiz

Take the quiz soon after you finish a phase, while the material is fresh. When you get a question wrong, open the lesson file the agent points you to before you retake the quiz.

Use the retake option to practise again. The skill avoids repeating questions until its pool runs out, and then it rephrases them. Treat a result as a self-check, not a formal assessment.

  • Use a local clone of the course so the agent reads lesson files directly.
  • Review the named lessons for each missed question.
  • Use the Explain a topic option for any concept you find unclear.

What people use it for

  • Check retention after finishing a phase of the AI Engineering from Scratch course before starting the next one.
  • Run a quick self-test on a single topic, such as transformers, before a study session.
  • Give a study group a consistent quiz built from the same course lessons.
  • Find which lessons in a phase need another read, based on the wrong-answer list.

Frequently asked questions

How do I install the Check Understanding skill?

Download the ZIP file from this page and unzip it into ~/.claude/skills/ for a personal install, or into a project's .claude/skills/ folder. In the Claude apps, you can instead upload it under Settings → Capabilities → Skills.

Is the Check Understanding skill free to use?

The skill is released under the MIT licence, as listed on this page. The source does not describe any pricing, so check the repository for licence terms.

Does the skill need internet access?

It needs either a local clone of the course repository or internet access. Without a clone, the agent fetches the course README and lesson files from GitHub.

Can I use it to learn a topic the course does not cover?

No. The questions come only from the course lesson documents, so the skill is not suitable for topics outside the course. It is also not an official certificate or graded exam.

Why does the agent say my phase does not exist?

Phases are numbered 0 to 19. If you enter a number outside that range, or a keyword that does not match the phase map, the agent tells you it is invalid and lists the valid phases to choose from.

How does this compare with other quiz tools?

The source does not compare this skill with other quiz tools. Its distinguishing feature is that questions are generated from the AI Engineering from Scratch lesson files, so they match that course's material.

New agent skills, repos and AI tools — every week

The best new skills and open-source projects, the fastest-growing repos, and one free prompt. Five minutes to read. Unsubscribe anytime.

Our verdict

Use this skill if you are working through the AI Engineering from Scratch course and want to check your retention before moving to the next phase. Pick a different resource if you need a graded exam, a certificate, or questions on topics the course does not cover, since the AI-generated questions may occasionally be imperfect.

Download the skill

Find exactly what
you're looking for