Table of Contents
- What counts as progress for an AI agent?
- Which tools should you use first?
- How do you track a fleet without lying to yourself?
- What does tracking cost once the agent is chatty?
- Which progress tool fits which job?
- How do you review progress in 20 minutes a day?
- What do founders ask about tracking AI agent progress?
- Is a chat transcript a progress tool?
- Can several people watch the same agent?
- What if the agent is not a coding agent?
- Do I need a separate observability vendor?
- What is the cheapest always-on setup for tracking?
Do not index

Track AI agent progress with git diffs, job timestamps, logs, and an alive check. A pretty status page that cannot show the last file written is not a tracker. Host the agent somewhere that stays up. Managed Basic is $3.99/mo (1 vCPU, 4 GB RAM, 8 GB). Tokens are separate and usually larger. If the only artifact is a chat bubble, you are not tracking progress. You are reading a diary.
Progress is a diff, a file, or a failed run with a time on it.
Everything else is decoration.
What counts as progress for an AI agent?
A committed diff, a file in a known folder, a successful cron, or a failed cron with a timestamp. "The model said it was done" is not progress. I want an artifact a second person can open without asking the agent to explain itself.
Four artifacts, in order:
- Git. Branch, commit, PR. For coding agents this is the scoreboard.
- Files. A report, a screenshot, a CSV in a path you chose before the run.
- Job log. Start, end, exit, tool calls. One stream per instance.
- Alive. Process up after a restart. If it died, the other three are stale.

Which tools should you use first?
Git, the host file browser, the host terminal, and a weekly token export. Add a dedicated tracker only after those four feel slow. Most teams buy a dashboard and still cannot find yesterday's branch.
Tool | What it proves | When it is the wrong tool |
Git / PR | Code actually changed | Ops bots that never touch a repo |
Instance files | The job wrote the artifact | When five agents share one folder |
Terminal and logs | What failed, and when | When logs from 5 agents are one soup |
Live desktop | Browser login still holds | Lean bots with no browser |
Provider usage page | Token dollars | When you only stare at the host invoice |
Cron history | The schedule ran | When success means exit 0 and an empty file |
On Agent 37 the browser terminal, file browser, and live desktop sit on the instance you already pay for. Pricing: Agent 37 pricing. Home: agent37.com.
Pro at $29.99/mo is the tier with Chromium. If progress depends on a logged-in site, that desktop is the tracker. A CPU chart will not show a logged-out session.
DIY is better when you already live in Grafana and the agent logs are just another service. Budget 4 hours. At $50/hour that is $200, more than a year of Basic ($47.88).
How do you track a fleet without lying to yourself?
One tracker stream per trust boundary. Engineer A's coding agent and Client B's bot do not share a log file "for convenience." Shared progress boards hide who spent the money and who touched the file.
Rules I would not bend:
- Name the output path before the run.
- Reject runs with no artifact. A cheerful summary is not a deliverable.
- Split host dollars from token dollars every week.
- Alert on silence. No commit and no file in 6 hours for a job that should have run is a failure.
- Keep a human confirm on external email and on spend over a cap you write down. I use $50 in a day as the "stop and look" line for a young fleet. Raise it when you have data.
I've run the tracker three ways. Laptop notes: gone when the lid closed, and then the progress vanished overnight. A $5 VPS and a text file: fine until the disk filled, and then the progress vanished overnight. Managed instance with git plus the file browser: the reboot did not eat the diff, and then the progress stayed overnight.
Related ops: how to monitor AI agents. Fleet shape: how to manage multiple AI agents.
What does tracking cost once the agent is chatty?

The tracker is cheap. The tokens are not. A quiet Basic instance is $3.99/mo. Five coding agents at $20/mo each in tokens is $100/mo. Your progress tool did not cause that. Your missing cap did.
[INSERT IMAGE: hosting.png]
Plan | Price | Tracking note |
Free | $0 | Sleeps. Progress stalls when idle. About 10 hours/week awake. |
Basic | $3.99/mo | Always-on files and terminal. 8 GB disk. |
Plus | $9.99/mo | 12 GB. More room for logs and artifacts. |
Pro | $29.99/mo | Chromium. Watch browser progress on a live desktop. |
Max | $99.99/mo | Team roles. More than one person can open the instance. |
Cloud API | About $4.76/mo awake | 2 vCPU, 4 GB RAM, 4 GB disk. White-label. Per minute. |
Rates: $0.80/vCPU, $0.70/GB RAM, $0.09/GB disk. Idle disk about $0.36/mo for 4 GB. Source: Agent 37 pricing. Homepage claim: agents for 100+ companies.
QM fleets track progress as room files and Slack threads, not as one personal git repo. Managed QM: QM agent hosting on Agent 37. It is early. Read
SECURITY.md.Which progress tool fits which job?

Coding jobs live in git. Ops jobs live in a file plus a cron timestamp. Browser jobs live on a desktop you can open. Using one tool for all three is how a fleet looks busy and ships nothing. Pick the scoreboard before the run, in writing, in one line.
Job | Scoreboard | Fail condition |
Overnight repo work | PR or diff | No commit in 6 hours |
Report or research | File at a path you named | Empty file, exit 0 |
Browser task | Live desktop plus screenshot file | Logged-out session |
Slack or web room | Message timestamp in that room | Webhook 404 |
A second tool is allowed after the first one has been wrong twice. Not before. I would rather an ugly git log than a polished board that cannot name the last file.
How do you review progress in 20 minutes a day?
One page: alive, last artifact, token spend, open incident. Twenty minutes. Not a war room.
- List instances. Mark any that slept or restarted.
- Open the artifact path. If it is empty, the job failed even if the log says success.
- Check yesterday's token total against your cap.
- Write one line on what a human must confirm before the agent emails or spends.
If that review takes 2 hours, the tools are in the wrong place. You are reconstructing state from chat.
What do founders ask about tracking AI agent progress?
Is a chat transcript a progress tool?
No. Keep it for debugging. Score the run on a diff, a file, or a timestamped failure.
Can several people watch the same agent?
Max at $99.99/mo includes team roles. Before that, do not share one login "temporarily."
What if the agent is not a coding agent?
Swap git for the file or the message it was supposed to send. The alive check and the spend check stay.
Do I need a separate observability vendor?
Not on day one. Use the host logs. Add Grafana or Datadog when you already operate them and the fleet is large enough that 4 hours of glue pays back.
What is the cheapest always-on setup for tracking?
Basic at $3.99/mo, plus BYOK tokens, plus a git remote you already have.
Start here: agent37.com from $3.99/mo.