devagrawal09/jev-review: first run, 2026-10-11
Installed from its README in a throwaway sandbox by Claude Code (Claude Opus 5.5), with a Jev API key in the environment and nothing else: no GPU, no desktop, no other paid keys, no accounts. The README's first example was run once. Repo commit 31f89602797f; 56 seconds. All results · Task
Quick start: ran. Jev calls made: 12.
| Install | cd ~/src && npm install && cp .env.example .env (then set TYPESAFE_API_KEY in .env from the environment, without printing it) |
|---|---|
| Quick start, as run | npm run review:changes:save -- ~/work/target (target = a throwaway 1-file git repo with an uncommitted one-line change to util.js) |
| What came back | Screening 1 changed source files with 0 changed test files as context... / profile util.js / Following 3 of 3 signals at or above 0.7... / inspect util.js [compatibility=0.93] [testGap=0.93] [correctness=0.87] / saved reviews/latest.json. The report has a risk matrix (correctness 0.87, security 0.11, reliability 0.66, compatibility 0.93, testGap 0.93) and 2 findings: compatibility/api with severity 1.95 and correctness/dataFlow with severity 1.91, both action=comment. Took about 2s. |
| What stopped it | Nothing. |
Steps the README does not mention
- This machine has Node v22.23.3, but the README requires Node 24+. npm install gave an EBADENGINE warning and still succeeded. The review ran fine on Node 22 because Node 22.18+ strips TypeScript types by default. I did not install Node 24.
- The README says 'Add TYPESAFE_API_KEY to .env' but does not say how. I wrote the key from the environment variable into .env.
- The quick start needs a target git repo with uncommitted changes, which the README does not provide. I created a throwaway repo at ~/work/target with one committed file and one uncommitted edit.
The session's closing message
Jev Review installed and its quick start worked on the first try. - **Install:** I ran `npm install` and `cp .env.example .env`, then put the key from `TYPESAFE_API_KEY` into `.env` without printing it. `.env` is gitignored. - **Quick start:** I ran `npm run review:changes:save -- ~/work/target`, which took about 2 seconds. It saved `reviews/latest.json` with a risk score for each review category and 2 findings (one compatibility, one correctness) about the one-line edit to `util.js`. The count of about 12 Jev calls is my estimate from reading the code; the project doesn't report it. - **Steps the README doesn't mention:** - The README requires Node 24+, but this machine has Node v22.23.3. `npm install` printed an unsupported-engine warning, and everything still ran because Node 22.18 and later can run TypeScript files directly. I did not install Node 24. - The quick start needs a git repo with uncommitted changes to review. I created a throwaway one at `~/work/target`. - The README says to add the key to `.env` but doesn't show the format. - **Not run:** I didn't start the dashboard, since you asked me to stop after the first real result. I didn't patch any project code. DELIVERABLE: ~/work/output/report.json