Get in Touch
 Duration 21 hours

Course Outline

Architectural Foundations for AI Systems

  • Defining layers, boundaries, and separation of concerns.
  • Applying ports and adapters patterns to AI components.
  • Establishing quality attribute scenarios for AI features.
  • Using Architecture Decision Records (ADRs) for governance.

Evolving Existing Applications

  • Pursuing incremental modernization over full rewrites.
  • Positioning AI services alongside existing monolithic structures.
  • Utilizing Strangler and anti-corruption layer patterns.
  • Creating integration seams for legacy APIs and data structures.

LLM Integration Architectural Patterns

  • Implementing a model gateway as an abstraction boundary.
  • Managing synchronous, asynchronous, and streaming integrations.
  • Configuring fallbacks, degradation, and provider failover strategies.
  • Treating prompt and model configurations as versioned assets.

Contracts, APIs, and Data Exchange

  • Defining structured output schemas and validation rules.
  • Implementing idempotency, retries, and rate limiting.
  • Managing latency budgets and timeout orchestration.
  • Viewing cost per request as a key architectural constraint.

End-to-End RAG Architecture

  • Building ingestion, chunking, and embedding pipelines.
  • Structuring index, retrieval, reranking, and generation stages.
  • Optimizing retrieval placement relative to application services.
  • Analyzing trade-offs and failure modes at each pipeline stage.

Vector Databases and Retrieval Design

  • Evaluating managed versus self-hosted vector stores.
  • Leveraging dense, sparse, and hybrid search techniques.
  • Applying metadata filtering and tenant isolation.
  • Planning re-embedding strategies when models evolve.

Retrieval Quality, Grounding, and Evaluation

  • Constructing evaluation sets from real-world queries.
  • Measuring retrieval and answer quality metrics.
  • Managing citations, grounding, and hallucination containment.
  • Creating feedback loops that refine the index.

Agent Architectures

  • Understanding the agent loop and tool invocation mechanisms.
  • Choosing between deterministic workflows and autonomous planners.
  • Identifying cases where agents are not the appropriate solution.
  • Defining agent responsibilities and state management scope.

Multi-Agent Systems and Orchestration

  • Designing supervisor and orchestrator topologies.
  • Establishing handoff protocols and message contracts.
  • Managing shared memory and context.
  • Comparing frameworks based on architectural merit.

Service Communication and Tool Protocols

  • Coordinating via event-driven and queue-based mechanisms.
  • Exposing tools through standard protocols.
  • Implementing sagas, compensation, and long-running transactions.
  • Ensuring observability across multiple service hops.

AI Agents in Development Workflows

  • Incorporating coding agents into the delivery pipeline.
  • Adopting spec-driven development and review gates.
  • Generating tests and automated quality checks.
  • Establishing guardrails to preserve architectural control.

Governance and Software Quality

  • Conducting design reviews for AI features.
  • Managing model and prompt changes systematically.
  • Including regression evaluation as a pipeline stage.
  • Defining ownership, policy, and approval pathways.

Security, Privacy, and Data Governance

  • Addressing prompt injection and implementing defense in depth.
  • Managing secrets, access control, and least privilege principles.
  • Handling data residency, personal data, and retention policies.
  • Ensuring auditability and human-in-the-loop controls.

Scalability, Cost, and Observability

  • Tracing performance across agent chains.
  • Monitoring token usage and cost telemetry.
  • Optimizing caching and latency.
  • Defining service levels and incident response for AI services.

Capstone: Architecture for an AI-Powered Solution

  • Developing context, component, and deployment views.
  • Designing retrieval and agent orchestration systems.
  • Formulating security, governance, and cost plans.
  • Conducting peer reviews, critique, and migration roadmapping.

Requirements

  • Practical experience in designing and maintaining production-grade software systems.
  • Proficiency in REST APIs and service integration patterns.
  • Working familiarity with relational databases and data modeling concepts.
  • Basic exposure to LLM-based tools or APIs.

Target Audience

  • Software Architects.
  • Technical Leads and Senior Engineers.
  • Engineering Managers responsible for architectural decision-making.

Number of participants


Price per participant

Testimonials (2)

Upcoming Courses

Related Categories