Inference is the operational phase in which a trained AI model receives new input and produces predictions, classifications, generated content, or other decisions. Cisco explicitly identifies Inference as an AI/ML workload type in DCAI objective 1.1.c. Unlike model training, which is dominated by iterative computation over large datasets, inference commonly handles production requests and is highly sensitive to response latency and throughput.
Cisco's AI POD design guidance states that inferencing workloads process live production traffic, often in real time, and evaluates them using metrics such as Time-to-First-Token, end-to-end request latency, inter-token latency, and requests per second. These characteristics directly support real-time decision making , making option C correct.
Option A concerns storage architecture rather than inference behavior. Option B incorrectly describes model architecture simplification, which inference does not inherently perform. Option D is also incorrect because inference pipelines can still require preprocessing, normalization, tokenization, or transformation of incoming data.
Study Guide Reference: 1.0 AI Fundamentals and Applications — 1.1 AI/ML workload types — 1.1.c Inference.
===============
Submit