Quickstart

Sign up, connect Azure DevOps with a personal access token, and watch ADO Pilot review a real pull request — about ten minutes end to end.

Last updated

This walkthrough takes you from no account to a completed AI review on a real pull request in about ten minutes. You don't need to install the Marketplace extension first, and you don't need a credit card. Running a review during setup is optional — if you don't have a pull request handy, skip it and ADO Pilot reviews your next one automatically.

Before you start, have these ready:

  • An Azure DevOps Services organization. To watch a review run during setup, have an open pull request in it ready — this is optional, and you can skip it and let your next PR trigger the first review.
  • A personal access token (PAT) for that organization with the scopes listed in Creating a personal access token. If you don't have one yet, create it now — the wizard asks for it in step two.

    Step 1 — Sign up

    Go to https://adopilot.dev. The landing page splits in two: a product overview on the left, and an auth card with Get Started and Sign In tabs on the right. Get Started is selected by default.

    1. Enter your work email in the you@company.com field.
    2. Enter a password (minimum eight characters) in the Min 8 characters field.
    3. Tick I agree to the Terms of Service. The Create Account button is disabled until you do.
    4. Click Create Account.

    The wizard redirects to a five-step onboarding flow that opens on Connect to Azure DevOps (the wizard sidebar labels this Step 2 of 5 — Step 1 is the signup you just completed).

    Step 2 — Connect to Azure DevOps

    On the Connect to Azure DevOps card, choose Personal Access Token and paste credentials.

    1. Click Personal Access Token.
    2. Paste your PAT into the Paste your PAT here field.
    3. Under Your first review, choose how to start:
      • Run my first review now (default) — paste the URL of an open pull request in your organization into the field labeled dev.azure.com/org/....
      • Skip for now — enter your organization name instead (for example, contoso). No PR is needed now; ADO Pilot reviews your next pull request automatically once setup finishes.
    4. Click Connect & Continue.

    The wizard validates the PAT and provisions a tenant for your organization. If you supplied a PR, it also starts a first review against it. On success it advances to step three.

    If the PAT is missing a scope or has expired, you'll see a specific error. See Troubleshooting PAT errors for the resolution for each error code.

    Step 3 — Configure repositories

    If you started a review in step two, this card is titled Your first review and runs that review in the background while you confirm settings. If you skipped it, the card is titled Configure repositories and confirms that your next pull request is reviewed automatically — there's nothing else to start now.

    Either way, click Continue to accept the defaults — all repositories enabled, default branch filters, default exclusion patterns. The wizard creates the service hook subscriptions in your Azure DevOps projects so future PRs trigger reviews automatically.

    Step 4 — Choose a plan (or skip)

    The Select a plan card shows the paid tiers side by side. To stay on the free trial, click Continue with N free credits, where N is your remaining trial allowance. To start a paid plan now, pick one and follow the Stripe checkout flow.

    The free-trial path does not collect payment details. Trial credits are consumed identically to paid credits.

    Step 5 — You're all set

    The final card displays You're all set!. At this point:

    • Your tenant is provisioned in ADO Pilot.
    • Service hooks are installed in the Azure DevOps projects you selected.
    • If you started a first review, it's either complete or running in the background.

    If you supplied a PR in step two, open it and watch the PR-level summary comment progress from queued to in progress to complete. Inline comments arrive when the second pass finishes. If you skipped the first review, open or update any pull request in a monitored repository — the review starts automatically within a few seconds.

What to do next

  • Make AI review a required check. Add the ai-pr-review status check (genre adopilot) as a branch policy in Azure DevOps to gate merges on review outcome. See Setting AI review as a required PR check.
  • Tune what gets reviewed. Add or adjust file exclusion patterns, branch filters, and per-repository toggles in the management portal. See Settings hierarchy.
  • Install the Marketplace extension. Optional. Adds a Run AI Review button to the PR action menu and a read-only settings hub inside Azure DevOps. See Installing the extension.