How it works

One bounded workflow, from source work item to writeback.

Every automation begins from a real work item in your tracker and ends with a recorded writeback. In between, the platform runs explicit phases with attempts, artifacts, and governed handoffs.

source · ADO 4821agent jobrefinementimplementationPR #312review-fixwriteback
01 - Vocabulary

Eight concepts that describe everything the platform does.

Source work item

The business-facing item in Azure DevOps, GitHub Issues, or GitLab Issues. The agent never invents work. Every run is anchored to an item your team already tracks.

Agent Job

An execution-facing record linked to the source. Process state, phases, attempts, and artifacts live here so the source stays clean for product owners.

Episode

A trigger event detected on the source: a new comment, a status change, a review request, or manual action. Episodes start or extend a job.

Phase

A bounded unit of agent work: refinement, implementation, review-fix. Each phase has explicit inputs, a model provider, and one or more attempts.

Attempt

A single execution of a phase. Attempts are retryable and recorded. If an attempt fails, you see why and can repair, retry, or escalate.

Artifact

Inspectable evidence produced by a phase: refined description, branch, commit, PR link, comment, or writeback result.

Writeback

The platform updates the source work item with status, links, and comments, closing the loop with the system your team already trusts.

Audit trail

Every episode, attempt, artifact, provider call, and human decision is recorded for portal inspection and later export.

02 - Core workflow

Source work item, to Agent Job, to writeback. Visible at every step.

portal / billing workspace / user-story / 4821
Fix billing webhook idempotency
ADO · User Story 4821 · assigned to billing-team
ai-enabled
Agent Job · job/4821
linked to source · controlled execution
Refinement
queued
Implementation
queued
Review
queued
PR #312 · agent/4821 -> main
3 files changed · CI green
Writeback to source
status, comments, PR link · audit recorded
stage 01 / 07source

A source work item exists

Every automation starts from a real business-facing item, initially an Azure DevOps User Story. Nothing in the platform happens without one.

scroll to advance · 6 stages remaining

03 - Lifecycle in detail

Seven stages, each with explicit inputs, outputs, and audit.

  1. Stage 01 · Sourceplatform

    A real work item enters the platform.

    The configured work-item connection is observed through polling or authenticated webhooks. When an item matches routing and enablement policy, an episode is created.

    • Routing maps source work to a repository
    • Enablement policy is explicit
    • First episode opens the Agent Job
  2. Stage 02 · Orchestrationplatform

    An Agent Job is created, linked, and scheduled.

    The Agent Job carries process state separate from the source story. Product owners read the source; operators read the job.

    • Linked back to source
    • Process graph initialized
    • Provider routing decided per phase
  3. Stage 03 · Refinementplatform

    The first phase produces a refined description.

    Refinement reads the source, asks for clarifications when ambiguous, and writes a structured description back as an artifact.

    • Bounded by phase config
    • Provider call recorded
    • Refined-description artifact attached
  4. Stage 04 · Implementationplatform

    A branch and commits appear in your repository.

    Implementation runs on the routed repository using configured model credentials. The agent writes code, validates, and commits to a job-scoped branch.

    • Branch: agent/<work-item-id>
    • Commits attributed to the job
    • Bootstrap checks re-validated
  5. Stage 05 · Pull requestplatform

    A PR opens - your reviewers, your CI, your rules.

    The pull request is a normal PR. CI runs, branch protections apply, and code owners are pinged.

    • PR links back to source
    • CI status surfaced
    • Awaiting review is a human checkpoint
  6. Stage 06 · Review fixhuman

    Review comments become the next episode.

    When a reviewer leaves a review comment, the platform creates a follow-up episode. A review-fix phase runs against the same Agent Job.

    • Threaded back to original PR
    • New attempts under same job
    • Reviewer can dismiss or escalate
  7. Stage 07 · Writebackaudited

    Status, links, and comments flow back to the source.

    When the PR merges or the job closes, writeback updates the source work item and records every artifact and decision.

    • Source work item updated
    • PR and branch links attached
    • Audit record preserved
04 - Example automation runs

Three concrete jobs: happy path, review-fix loop, and governed repair.

Every run below is a real shape of audit timeline you will see in the portal. Same vocabulary, same evidence - whether the job ran clean, looped through review, or needed an operator.

merged

Happy path - small bug fix lands in one PR

ADO · Bug 4821 · billing-svc

An AI-enabled bug story is picked up by polling. Refinement clarifies the repro, implementation patches the idempotency key, and the PR merges after review.

portal / agent-jobs / happy-path / audit
10:14:02
episode · created
trigger: AI-enabled flag set on Bug 4821
run
10:14:05
agent-job · job/4821
linked to source · routed to billing-svc repo
run
10:14:48
refinement · attempt 1
ok · provider:openai · artifact:refined-desc
ok
10:18:11
implementation · attempt 1
ok · branch:agent/4821 · 3 files changed
ok
10:21:37
pr-open · #312
CI green · code owners notified
run
11:02:14
review · approved
reviewer: @maria · 0 change requests
human
11:04:40
pr-merge · #312
squash · main
ok
11:04:45
writeback · ok
target:ADO/4821 · status -> Done · PR linked
ok
merged

Review-fix loop - reviewer requests a tighter window

ADO · User Story 5104 · checkout-api

First implementation passes CI, but the reviewer flags a replay window issue. The review comment becomes a new episode and a review-fix phase runs.

portal / agent-jobs / review-fix / audit
09:02:11
episode · created
User Story 5104 · AI-enabled
run
09:03:48
refinement · attempt 1
ok · 1 clarifying comment posted
ok
09:11:02
implementation · attempt 1
ok · branch:agent/5104
ok
09:14:30
pr-open · #847
CI green
run
09:46:22
review-comment
@reviewer: handle replay window of 5m
human
09:46:25
episode · created
trigger: review-comment on PR #847
run
09:48:10
review-fix · attempt 1
ok · provider:anthropic · 1 commit pushed
ok
10:05:01
pr-merge · #847
main
ok
10:05:06
writeback · ok
ADO/5104 -> Done · 2 episodes recorded
ok
merged after retry

Failure and repair - provider error, explicit operator retry

ADO · Task 6620 · search-indexer

Implementation hits a provider rate limit on attempt 1. The job halts visibly. An operator inspects the attempt and triggers a retry.

portal / agent-jobs / repair / audit
14:20:02
episode · created
Task 6620 · AI-enabled
run
14:20:48
refinement · attempt 1
ok · artifact:refined-desc
ok
14:22:11
implementation · attempt 1
fail · provider:openai · 429 rate_limited
fail
14:22:11
job · halted
phase blocked · operator notification sent
human
14:31:40
operator · retry
@oncall · attempt 2 scheduled
human
14:33:05
implementation · attempt 2
ok · provider:openai · branch:agent/6620
ok
14:36:21
pr-open · #1188
CI green
run
15:02:09
pr-merge · #1188
main
ok
15:02:14
writeback · ok
ADO/6620 -> Done · attempt history attached
ok

Every event above is exportable. Nothing the agent does is invisible - that is the point.

Book a walkthrough

Bring AI work into the same process you already trust.

Connect your work-item systems, repositories, and model runtimes. Keep every automated step visible and governed.