Skip to content
FrankX.AI
Enterprise AIJan 21, 20268 min read1,553 words

Production LLMs & AI Agents on OCI: Part 2 - Six Agent Orchestration Patterns

TL;DR

Not all agent workflows are equal. This pattern library maps six orchestration patterns to OCI services, with explicit decision criteria for each. Match your workflow requirements to the right pattern before you write a single line of code.

Frank Riemer
FrankX
AI Architect & Independent Creator
Ex-Oracle AI Architect · Starlight & ACOS Systems
The complete pattern library for agent orchestration on OCI: Sequential, Concurrent, Group Chat, Handoff, Orchestrator-Worker, and Human-in-the-Loop.
Reading Goal

You'll master production agent architecture, tool integration patterns, and resilient multi-agent orchestration systems.

Production LLMs and AI Agents on OCI: Six Agent Orchestration Patterns

TL;DR: Not all agent workflows are equal. This pattern library maps six orchestration patterns to OCI services, with explicit decision criteria for each. Match your workflow requirements to the right pattern before you write a single line of code.

Disclosure: Independent analysis. Not affiliated with, endorsed by, or sponsored by Oracle. Uses public OCI documentation and general enterprise architecture patterns, not confidential Oracle or customer material.

The Pattern Selection Problem

Most teams pick an orchestration pattern based on what they saw in a tutorial, not what their workflow actually requires.

This leads to:

  • Over-engineering: Building complex multi-agent systems for simple linear workflows
  • Under-engineering: Using linear chains when concurrent or collaborative patterns would dramatically improve quality
  • Wrong abstraction: Fighting the pattern instead of leveraging it

The solution: Pattern-first design. Understand your workflow characteristics, then select the pattern that fits.

The Pattern Selection Problem diagram 1
The Pattern Selection Problem

Pattern 1: Sequential Orchestration

Definition: Chains agents in a predefined linear order. Each agent processes the output from the previous agent, creating a pipeline of specialized transformations.

Pattern 1: Sequential Orchestration diagram 2
Pattern 1: Sequential Orchestration

When to Use Sequential

Use WhenAvoid When
Stages have clear linear dependenciesStages can be parallelized
Each stage adds specific value for the nextSingle agent can handle the full task
Workflow progression is predictableWorkflow requires backtracking
Performance of each stage is well-understoodAgents need to collaborate dynamically

OCI Implementation

ComponentOCI ServiceConfiguration
RuntimeOCI AI Agent PlatformWorkflow definition with sequential steps
StateAutonomous JSON DBDocument state accumulates across stages
OrchestrationOKE + LangGraphStateGraph with linear edges
MonitoringOCI APMTrace spans for each stage

Example: Contract Generation Pipeline

Example: Contract Generation Pipeline diagram 3
Example: Contract Generation Pipeline

Pattern 2: Concurrent Orchestration

Definition: Runs multiple agents simultaneously on the same task. Each agent provides independent analysis from its unique perspective. Results are aggregated for final output.

Pattern 2: Concurrent Orchestration diagram 4
Pattern 2: Concurrent Orchestration

When to Use Concurrent

Use WhenAvoid When
Tasks can run in parallelAgents need to build on each other's work
Multiple perspectives improve qualityDeterministic, reproducible results required
Time-sensitive scenariosResource constraints limit parallelization
Brainstorming, ensemble decisionsConflict resolution logic is too complex

OCI Implementation

ComponentOCI ServiceConfiguration
RuntimeOKE with parallel podsEach agent in separate pod
OrchestrationLangGraph parallel nodesparallel_branch construct
AggregationOCI FunctionsWeighted voting, consensus logic
MonitoringOCI APMParallel span tracking

Example: Investment Analysis

Example: Investment Analysis diagram 5
Example: Investment Analysis

Pattern 3: Group Chat Orchestration

Definition: Multiple agents solve problems through shared conversation threads. A chat manager coordinates flow, determining which agents respond and when.

Pattern 3: Group Chat Orchestration diagram 6
Pattern 3: Group Chat Orchestration

When to Use Group Chat

Use WhenAvoid When
Creative brainstorming with multiple perspectivesSimple task delegation suffices
Iterative refinement through discussionReal-time processing required
Quality control with maker-checker loopsClear hierarchical decision-making
Multidisciplinary problemsChat manager can't determine completion

OCI Implementation

ComponentOCI ServiceConfiguration
RuntimeOCI AI Agent PlatformMulti-agent conversation
Chat ManagerOCI FunctionsTurn selection logic
Message StoreAutonomous JSON DBConversation history
MonitoringLogging AnalyticsFull conversation audit

Maker-Checker Variant

A common group chat pattern where one agent creates and another validates:

Maker-Checker Variant diagram 7
Maker-Checker Variant

Pattern 4: Handoff Orchestration

Definition: Enables dynamic delegation between specialized agents. Each agent assesses whether to handle the task directly or transfer to a more appropriate agent based on context.

Pattern 4: Handoff Orchestration diagram 8
Pattern 4: Handoff Orchestration

When to Use Handoff

Use WhenAvoid When
Specialized knowledge required dynamicallyAppropriate agent known upfront
Expertise requirements emerge during processingSimple rule-based routing suffices
Multiple domains but one at a timeMultiple agents needed concurrently
Logical signals indicate capability limitsRisk of infinite handoff loops

OCI Implementation

ComponentOCI ServiceConfiguration
RuntimeOCI AI Agent PlatformAgent-to-agent routing
RouterOCI FunctionsHandoff decision logic
StateAutonomous JSON DBConversation context persists
EscalationOracle Digital AssistantHuman handoff integration

Example: Customer Service Escalation

Example: Customer Service Escalation diagram 9
Example: Customer Service Escalation

Pattern 5: Orchestrator-Worker

Definition: A manager agent dynamically builds a task ledger with goals and subgoals, invoking specialized worker agents as needed. The plan evolves as context changes.

Pattern 5: Orchestrator-Worker diagram 10
Pattern 5: Orchestrator-Worker

When to Use Orchestrator-Worker

Use WhenAvoid When
Complex problems without predetermined solutionSolution path is deterministic
Multiple specialists needed to develop valid planNo requirement for documented plan
Plan review required before/after implementationTime-sensitive (pattern focuses on planning)
Agents interact with external systemsLow complexity where simpler patterns suffice

OCI Implementation

ComponentOCI ServiceConfiguration
OrchestratorLangGraph on OKEDynamic subgraph spawning
Task LedgerAutonomous JSON DBReal-time plan updates
WorkersOCI AI Agent PlatformSpecialized agents with tools
ToolsMCP Servers on OKEExternal system integration
AuditOCI Audit + LoggingComplete decision trail

Example: SRE Incident Response

Example: SRE Incident Response diagram 11
Example: SRE Incident Response

Pattern 6: Human-in-the-Loop

Definition: Explicit breakpoints where human approval is required before the workflow continues. Critical for high-stakes decisions.

Pattern 6: Human-in-the-Loop diagram 12
Pattern 6: Human-in-the-Loop

When to Use Human-in-the-Loop

Use WhenAvoid When
High-stakes decisions (financial, legal, medical)All decisions can be automated
Compliance requires human approvalApproval latency is unacceptable
Building trust in AI systemVolume makes human review impossible
Training data collectionClear rules can replace judgment

OCI Implementation

ComponentOCI ServiceConfiguration
Approval UIOCI APEXApproval queue with context
State PersistenceAutonomous JSON DBWorkflow paused state
NotificationsOCI NotificationsSlack, email, SMS alerts
TimeoutOCI Events + FunctionsAuto-escalate on timeout
AuditOCI AuditAll approval decisions logged

Checkpoint Placement Strategy

Checkpoint Placement Strategy diagram 13
Checkpoint Placement Strategy

Pattern Decision Matrix

Quick reference for pattern selection:

Pattern Decision Matrix diagram 14
Pattern Decision Matrix

OCI Service Mapping Summary

PatternPrimary OCI ServiceSupporting Services
SequentialAI Agent PlatformAutonomous DB, Object Storage
ConcurrentOKE + LangGraphFunctions, APM
Group ChatAI Agent PlatformLogging Analytics, JSON DB
HandoffAI Agent PlatformDigital Assistant, Functions
Orchestrator-WorkerLangGraph on OKEAgent Platform, Audit
Human-in-LoopAPEX + Agent PlatformNotifications, Events

What's Next

Part 3: The Operating Model — Evaluation pipelines, CI/CD for AI, incident response, cost management, and the 5-tier maturity roadmap.

Resources

This is Part 2 of a 3-part series on production LLM and agentic AI systems on OCI.

Part 1: Six-Plane Architecture | Part 3: Operating Model

Related Articles

Stay in the intelligence loop

Weekly field notes on AI systems, production patterns, and builder strategy.

Occasional FrankX field notes. Unsubscribe anytime. Privacy details.