Re-running a review

ADO Pilot runs a review automatically every time you push to an open PR. When you want a fresh review without pushing — for example, after fixing a transient error or tweaking review settings — you have two manual triggers: the Run AI Review action on the PR, or the retry link in the admin portal.

Automatic — review on push

The default setting reviewOnPush: true makes every push to an open PR trigger a review:

1. You push a commit (or open the PR for the first time).
2. Azure DevOps fires a git.pullrequest.created or git.pullrequest.updated service hook to ADO Pilot.
3. The orchestrator queues a review against the latest commit.
4. The tracking comment on the PR walks through queued → in progress → complete.

You do not need to click anything. Push and wait.

Manual — the Run AI Review button

When you want to re-run the review against the commit that is already on the PR:

1. Open the PR in Azure DevOps.
2. Open the PR action menu (the ... menu next to the PR title) and choose Run AI Review.
3. ADO Pilot queues a fresh review against the current head commit. The tracking comment updates in place.

This is the right tool when:

• The previous review errored (PROVIDER_RATE_LIMITED, transient model failure) and you want to retry without producing a no-op commit.
• You changed an exclusion pattern or a review setting and want to see the effect on this PR.
• You want a second opinion on the same commit without rewriting history.

The button is disabled when:

• The PR is closed, merged, or abandoned. Reviews only run on open PRs — see What is not reviewed.
• A review is already queued or in progress for this PR. Pushing another commit while a review is running starts a fresh review on the new commit and abandons the old one — see Mid-review pushes.
• The PR has zero reviewable files (every changed file is excluded, or the diff is empty).

Manual — retry from the admin portal

Every review has a detail page in the admin portal at https://app.adopilot.dev/reviews/{reviewId}. Errored reviews show a Retry action there. Clicking it re-queues a review against the same PR and the same commit that the original ran on.

You will use the portal retry path when:

• You found the original review through a search or notification rather than from the PR itself.
• The PR has scrolled past your immediate workflow but you want to re-examine why the review failed.

Successful reviews (PASS, ADVISORY, FAIL) do not have a Retry action — there is nothing to retry. To re-run a successful review, use Run AI Review on the PR or push a new commit.

Disabling automatic reviews

If you prefer to control timing yourself — for example, your team batches changes and only wants a review on the final commit — turn reviewOnPush off:

1. In the admin portal, go to Settings → Repositories.
2. Find the repo and toggle Review on push to off.
3. Save.

With reviewOnPush disabled:

• Pushes no longer trigger reviews. The webhook still arrives at ADO Pilot but the orchestrator skips it and records the skip.
• The Run AI Review button on the PR is the only way to start a review.
• The portal retry path still works for any reviews that did run before the setting changed.

This setting is per repo, so you can mix automatic and manual repos in the same org.