Copyright (c) 2026 MindMesh Academy. All rights reserved. This content is proprietary and may not be reproduced or distributed without permission.

1.3.2. SageMaker Components and When to Use Them

💡 First Principle: Each SageMaker component solves one specific problem in the ML lifecycle. The exam tests your ability to match the problem description to the correct component—not your knowledge of SageMaker's marketing materials.

ComponentLifecycle StagePrimary UseKey Exam Signals
Data WranglerData PrepVisual data prep, feature engineering"Minimal code," "visual interface," "data exploration"
Feature StoreData PrepCentralized feature repository"Reuse features," "online/offline store," "feature consistency"
Ground Truth (closed to new customers)Data PrepHuman data labeling workflows"Labeling," "annotation," "human reviewers"
Training JobsModel DevScalable model training"Train at scale," "distributed training," "GPU instances"
Automatic Model Tuning (AMT)Model DevHyperparameter optimization"Hyperparameter tuning," "Bayesian optimization," "best parameters"
JumpStartModel DevPre-trained models and solutions"Pre-trained," "transfer learning," "quick start"
CanvasData Prep + Model DevNo-code model building over your own data"No ML team," "business analyst," "no code," "visual," new time-series forecasting
AutopilotModel DevAutoML for tabular classification and regression"AutoML," "automatically select the algorithm," "tabular," candidate leaderboard
ExperimentsModel DevTrack and compare training runs"Compare experiments," "track metrics," "reproducibility"
Model RegistryModel Dev → DeployModel versioning and approval"Model version," "approval workflow," "model governance"
Clarify (closed to new customers)Data Prep + Model Dev + MonitorBias metrics and SHAP explanations"Bias," "explainability," "SHAP values," "fairness"
Debugger (closed to new customers)Model DevTraining-time convergence rules and profiling"Vanishing gradients," "exploding gradients," "overfitting during training"
TensorBoard in SageMaker AIModel DevInspect gradients, weights and activations across training steps"Gradient histograms," "weight distributions," "vanishing or exploding gradients"
EndpointsDeploymentReal-time inference serving"Real-time predictions," "low latency," "endpoint"
Batch TransformDeploymentLarge-scale offline inference"Batch predictions," "no persistent endpoint," "offline scoring"
PipelinesDeploymentML workflow orchestration"Automate workflow," "DAG," "orchestrate steps"
NeoDeploymentModel optimization for edge"Edge deployment," "optimize model," "IoT"
Model Monitor (closed to new customers)MonitoringScheduled data/model drift checks"Drift," "data quality," "production monitoring," "baseline"
Inference RecommenderMonitoringEndpoint sizing recommendations"Rightsizing," "instance selection," "load testing"

📌 Availability note (checked against AWS documentation, October 2026): Amazon SageMaker Clarify, Model Monitor, Ground Truth, Debugger and Augmented AI (A2I) have all been closed to new customers since 30 July 2026. Existing customers can continue to use them as normal, and AWS still makes security and availability improvements, but it plans no new features. The MLA-C02 exam guide no longer names Clarify, Model Monitor or Ground Truth; it phrases those skills as capabilities: "explain model outputs", "create model performance baselines and implement drift detection", and labeling and annotation. The exam guide likewise phrases the Debugger skill as "debug model convergence issues" and the A2I one as "human-in-the-loop workflows", without naming a tool. The concepts behind all five (bias metrics, SHAP, baselines, Data Capture, drift types, and gradient and convergence failure patterns) are still exam content. What changes is the tool a new team adopts:

CapabilityClosed toolWhat AWS recommends for a new team
Pre- and post-training bias metrics (CI, DPL, DI, DPPL)ClarifyCompute the published formulas with pandas and scikit-learn in a SageMaker Pipelines processing step, and log results to a SageMaker AI MLflow App
Explaining predictions (feature attribution)ClarifyThe open-source SHAP library, the same engine Clarify uses internally
Data quality and model quality driftModel MonitorAWS's open-source SageMaker AI monitoring solutions (Evidently AI and MLflow, run by EventBridge and Lambda or a scheduled SageMaker Pipeline, with SNS alerts), plus CloudWatch metrics and anomaly detection alarms
Bias drift and feature attribution driftModel Monitor with ClarifyThe same monitoring solutions, recomputing per-segment fairness metrics and SHAP importance on a schedule
Training convergence debugging and profiling (built-in rules, profiler)DebuggerA SageMaker AI MLflow App for metric logging and run comparison, TensorBoard in SageMaker AI for gradient and weight histograms, and CloudWatch training-job metrics and alarms for utilization and automated alerts (see 3.3.3)
Foundation model evaluationClarify (FMEval)The fmeval library or Amazon Bedrock Evaluations, with Amazon Bedrock Guardrails for runtime safety. Neither replaces tabular bias or explainability analysis
Human data labelingGround TruthAWS documents no replacement. Existing customers continue with a private or vendor workforce
Human review of model predictionsA2IAWS documents no direct replacement. To compare foundation-model outputs, Amazon Bedrock model evaluation jobs can use your own human workers (see 3.4.6)

⚠️ Exam Trap: Bias analysis appears in two lifecycle stages: pre-training bias detection on the dataset (Stage 1) and bias drift on production predictions (Stage 4), whichever tool computes it. Similarly, Feature Store has an online store (low-latency inference lookups) and an offline store (batch training data). Questions test whether you understand these dual roles. When a scenario says the team is new to a service or is building in a new AWS account, rule out tools that are closed to new customers.

Reflection Question: A team notices their model's predictions disproportionately affect one demographic group. Which bias metrics and which AWS approach should they use, and does it matter whether the model is in development or already deployed?

See how it connects
Alvin Varughese
Written byAlvin Varughese
Founder•20 professional certifications