Guide · Agent skill
How to use the SageMaker Deployment Planner agent skill
Updated · written with AI from the project's own documentation and checked against our catalogue data
The SageMaker Deployment Planner is an agent skill that makes an AI agent act as the planner when you want a model hosted on Amazon SageMaker AI. It is aimed at developers and teams who know they want a model running on AWS but are not sure which endpoint type to pick. After reading this guide you will know how to install the skill, how to phrase a request so it triggers, what the agent will ask you, and what it needs from your AWS account.
Quick start
- 1Download and unzip the skill. Download the ZIP from this page and unzip it into ~/.claude/skills/ for all projects, or .claude/skills/ inside one project. In the Claude apps, upload it under Settings → Capabilities → Skills instead.
- 2Confirm AWS access. Make sure your AWS account has SageMaker access and that the AWS CLI is available to the agent.
- 3Make a plain-language request. Ask for the deployment in your own words, naming the model and roughly how often it will be called.
- 4Answer the short clarifying questions. The agent asks only what it still needs, such as latency tolerance or artifact location.
- 5Review the recommended pathway. The agent proposes an endpoint type and instance and explains alternatives in one sentence each.
- 6Check the quota result. The agent runs the read-only service-quotas check and recommends an instance your account can launch.
- 7Confirm before anything is created. Reply yes only when you accept the recommended pathway and instance, then let the companion skills carry out the setup.
What the skill makes the agent do
An agent skill is a folder with a SKILL.md file that gives an AI agent specific instructions for one kind of task. This skill covers the planning part of a SageMaker deployment: it asks a few short questions about the model, expected traffic and latency needs, recommends a hosting pathway, and checks whether your account has enough GPU quota for the instance it suggests.
The skill lists real-time endpoints, real-time with scale to zero, serverless, async inference, batch transform and Bedrock Custom Model Import as pathways. It states that real-time, real-time scale-to-zero and async are the three that are scripted. Serverless, batch transform and Bedrock Custom Model Import get only a brief hand-off explanation.
- Asks the minimum needed: which model, and roughly how often it will be called
- Picks a pathway and says why, in one sentence per option
- Runs a read-only quota check with aws service-quotas before recommending an instance
- Hands setup to companion skills for AWS context, Python environment, IAM, image selection and deployment defaults
Install the skill from the ZIP
Download the ZIP for this skill from this page and unzip it. To make it available across all your projects, place the unzipped folder in ~/.claude/skills/. To limit it to one project, place it in that project's .claude/skills/ folder.
If you use the Claude apps instead, open Settings, go to Capabilities, and upload the skill under Skills.
- Personal install: ~/.claude/skills/
- Project install: .claude/skills/ inside your project folder
- Claude apps: Settings → Capabilities → Skills
Ask for a deployment in plain language
You do not need special syntax. The skill's description lists phrases it responds to, such as deploy a model, host this LLM on AWS, serve this embedding model, deploy a reranker, host this for async inference, create an endpoint, or serve my fine-tuned model. It also responds to vague requests like wanting a model running on AWS with the agent choosing the details.
Give the agent the model name or an S3 path to your artifacts if you have them. The model name usually tells the agent whether it is an LLM or an embedding model.
- Good: "Deploy Qwen3-0.6B on SageMaker. I'll call it a few times a day."
- Good: "Host this fine-tuned model from s3://my-bucket/model for async inference."
- Vague but supported: "I just want this running on AWS, you figure it out."
What the agent will ask and how it decides
The skill tells the agent not to front-load questions. A typical minimal set is what model you want and roughly how often it will be called. If you already answered something, the agent should not ask again. Region comes from the companion context-discovery skill, so you will not be asked for it unless you mention it.
Before creating anything, the agent states a recommendation and waits for your confirmation, so you know what you are about to spend money on.
What the skill needs
You need an AWS account with SageMaker access, and the AWS CLI available to the agent, because the quota check runs aws service-quotas commands. The skill also coordinates five companion skills: hf-cloud-aws-context-discovery, hf-cloud-python-env-setup, hf-cloud-sagemaker-iam-preflight, hf-cloud-serving-image-selection and hf-cloud-sagemaker-production-defaults. The deployment scripts deploy.py, deploy_ic.py and deploy_async.py are referenced from the production-defaults skill and are not included in this file, so you will need that companion skill to run them.
- AWS account with SageMaker access and permission to create SageMaker resources
- AWS CLI installed and usable by the agent
- Companion skills listed above
- Note: the skill's own file list is SKILL.md only
aws service-quotas list-service-quotas --service-code sagemaker --region <region> --query "Quotas[?contains(QuotaName, 'for endpoint usage') && Value > `0`].[QuotaName, Value]" --output tableSafety notes: scripts and network access
The skill is marked as running scripts and using the network. Its quota check is read-only and runs through the AWS CLI. The deployment itself is carried out by scripts in the companion production-defaults skill, so review those before running them.
The skill says a failed quota check should not stop the workflow, and it should not ask you to change IAM for a preflight check. The real limit will appear as ResourceLimitExceeded during deployment. Do not confirm a deployment for an instance type you have not agreed to, because the skill says the user should know what they are spending before anything is created.
- Quota check is a preflight optimization, not a gate
- Deployments create billable SageMaker resources only after you confirm
- Scripted deployment lives in the companion skill, not in this file
Tips for better results
Tell the agent how often the model will be called and how quickly responses must arrive. Those two answers drive most of the pathway choice. If you need an interactive app, say so, because the skill warns that scale-to-zero real-time endpoints can fail every request during the wake-up period with a 400 error.
For GPU instances, the skill notes that ml.g5 and ml.g6 are both 24 GB tier options and that ml.g6e suits models that do not fit in 24 GB. For small embedding models, the skill suggests asking for CPU variants first.
- Name the exact model ID or S3 path
- State your latency need: interactive, near-real-time or async
- For embedding models under 1B parameters at moderate traffic, expect a CPU recommendation
- If the quota shows zero for a GPU type, ask for a different instance or request an increase before deploying
What people use it for
- Hosting a Hugging Face LLM on a steady-traffic real-time endpoint
- Serving an embedding model on a CPU instance when it is small and traffic is moderate
- Choosing async inference for long text-to-image or diffusion jobs with large payloads
- Deciding between always-on real-time and scale-to-zero for a dev or test endpoint
- Hosting a fine-tuned model from an S3 artifact location
Frequently asked questions
How do I install the hf-cloud-sagemaker-deployment-planner skill?
Download the ZIP from this page and unzip it into ~/.claude/skills/ for all your projects, or into a project's .claude/skills/ folder for one project. In the Claude apps, you can instead upload it under Settings, Capabilities, Skills.
What does this skill require to run?
You need an AWS account with SageMaker access and the AWS CLI available, since the quota check runs aws service-quotas commands. It also depends on five companion skills and on deployment scripts that come from the production-defaults companion skill, not this file.
Is the SageMaker Deployment Planner free to use?
The skill is published under the Apache-2.0 licence. The source does not state pricing for the skill itself, but deployed SageMaker endpoints are billable AWS resources, so check AWS pricing before you confirm a deployment.
Does this skill deploy the model by itself?
It plans and coordinates the work. The actual setup is handed to companion skills, and the scripted pathways are real-time, real-time scale-to-zero and async. Serverless, batch transform and Bedrock Custom Model Import only receive a hand-off explanation.
Why does my scale-to-zero endpoint fail on the first request?
According to the skill, real-time scale-to-zero endpoints are slow on the first request after idle, and every request during the wake-up can fail with a 400 error. Use it only when your client can tolerate that and retry, and avoid it for interactive apps.
Should I use real-time or async inference?
The skill suggests async when one inference can exceed the 60-second InvokeEndpoint limit, when payloads are large, or when the client can accept an S3 result. It suggests real-time scale-to-zero when the client needs a normal synchronous HTTP response and can retry through the wake-up.
New agent skills, repos and AI tools — every week
The best new skills and open-source projects, the fastest-growing repos, and one free prompt. Five minutes to read. Unsubscribe anytime.
Our verdict
This skill suits developers and teams who want a model on SageMaker and do not want to choose the endpoint type themselves, and who have AWS access and permission to create resources. It is not a fit for people without an AWS account, for interactive apps that cannot tolerate slow wake-ups, or for serverless, batch transform or Bedrock import deployments, which it does not script.
Download the skill