← All reviews · Local models & inference

local-models/runtimessmoke testsmoke test Rocky's quickest test: fresh sandbox, does it install and does the README example run? Glossary

uzu: the Rust inference engine that 'absolutely rips'

The claim“This local Rust-based inferenceinference Using a trained model to get answers (as opposed to training it). Glossary · Learn more engine absolutely rips”

GitHubtrymirai/uzu2.4kStars152Forks18Issues + PRsMITlicense (Apache-2.0, MIT) The rules for using the code. Apache-2.0 and MIT both allow free use, including commercial use. Glossary · Learn moreLicenseLast pushRustLanguage

Live stats · checked

Review lives at rockytested.com · @RockyTested

🧪 Run finished . Rocky is checking the numbers before any verdict.
Rocky dressed for Speed claimsTesting badge: Rocky in his lab coat

Speed claims Rocky · in the lab

With vs without

With it loadedNot tested yet

No with-skill pass count is on file.

Without itNot tested yet

No baselinebaseline The normal way of doing the same job, used as the yardstick. Rocky compares every claim against a baseline on the same machine. Glossary pass count is on file.

Usefulness is a separate question from “does the repo exist.” It needs the same task run twice. Until that A/B is published, both cells stay blank.

What the test plan says

Smoke first: build the engine from source with cargo at a pinned tag and confirm the CLI runs. A tokenstoken The small chunks a model reads and writes. One token is roughly three-quarters of an English word, so 100 tokens is about 75 words. Glossary · Learn more-per-second claim run against a downloaded model is queued.

Four verdicts

One stamp is not the whole story. Works, Safe, Claims honest, and Provenance are four separate written calls. A missing call stays “not tested yet.”

WorksNOT TESTED YETDid it do the thing when Rocky ran it?

No written call is on file. This is not a pass.

SafeNOT TESTED YETSafe to install and run?

No written call is on file. This is not a pass.

Claims honestNOT TESTED YETDoes the pitch match what Rocky measured?

No written call is on file. This is not a pass.

ProvenanceNOT TESTED YETDoes the repo's history check out?

No written call is on file. This is not a pass.

Safety is a hard cap. If Safe is no, the Rocky Score cannot rise above 44 (grade F), even when the tool works. A blank Safe card means not tested yet, not safe. How the four verdicts roll up →

Claim vs what Rocky measured
Claim vs what Rocky measuredThe claim: This local Rust-based inference engine absolutely rips. The claim: Measuring… (measuring).THE CLAIM“This localRust-based inferenceengine absolutelyrips• Source: X postvsWHAT ROCKY MEASURED⚗The claimMeasuring…Claim vs what Rocky measuredThe claim: This local Rust-based inference engine absolutely rips. The claim: Measuring… (measuring).THE CLAIM“This local Rust-basedinference engineabsolutely rips• Source: X postvsWHAT ROCKY MEASURED⚗The claimMeasuring…
Claim partMeasuredResult
The claimMeasuring…measuring

What it is: A high-performance local inference engine written in Rust. Rocky first checks it builds and runs, then will measure real decode speed so 'rips' becomes a number. Claim source →

Results coming. Here’s what Rocky will measure

  • Does it build from source
  • Does the CLI run
  • Decode tokens/second on a real model (claim run, queued)

Smoke first: build the engine from source with cargo at a pinned tag and confirm the CLI runs. A tokens-per-second claim run against a downloaded model is queued.

Sneak peek

Claim ledger

Every distinct claim in the pitch gets a row: what was said, what the command said back. 1 claim on the ledger: 1 not measured. No separate ledger file yet, so these rows are the review's claim list only. “Not tested” means that claim has no measurement.

🔍 Coverage: Not stated yet. Rocky only lists the parts a run actually checked.

⚗️ Unproven usefulness. Counting and parsing can settle what the repo claims. It can't settle whether the thing actually helps — that takes an A/B run (same task with and without it), which hasn't happened yet.

Rocky's take

Not written yet.

Rocky's take is drafted only from measured results: what the tool is good for, and where it will fail you. Until those results exist, this stays blank. Nothing here is guessed.

Where this repo comes from

Not checked yet.

Provenance is age, authors, commitcommit One saved version of a repo's code. Rocky pins the exact commit so anyone can rerun the same code. Glossary · Learn more bursts, and where the README sends you. It is published only from commands Rocky ran. Nothing is guessed, so this section stays blank until that file exists.

Score

Scorepending

Not scored yet. A Rocky Score is a rollup of measured subscores only. This review does not have one, and no grade is filled in to hold the place.

Rerun it yourself

📦 When the test is done, the exact scripts, raw results and a copy-paste prompt for your own AI agentAI agent An AI that takes actions in steps (runs commands, edits files, browses) instead of only chatting. Glossary · Learn more will appear here.

Repo & thanks

Where the claim was posted

Daniel Jeffries
@Dan_Jeffries1 ·
The claim Rocky tested

Gosh almighty, this local rust based inference engine absolutely rips! Uzu. https://github.com/trymirai/uzu

💬 4🔁 7❤️ 116📊 9.9K🔖 155

Counts as of (Rocky's last check)

Open on X →

Where else this repo is talked about

On X: 1 posts linking the repo

Posts from to , in several languages. Found with X search for links to the repo; more may exist. Oldest first:

  • Earliest we found @Dan_Jeffries1 Gosh almighty, this local rust based inference engine absolutely rips! Uzu. https://github.com/trymirai/uzu❤️ 116 · 🔁 7 · 📊 9.9K open
All 1 posts, oldest first
  • Earliest we found @Dan_Jeffries1 Gosh almighty, this local rust based inference engine absolutely rips! Uzu. https://github.com/trymirai/uzu❤️ 116 · 🔁 7 · 📊 9.9K open

Ran it yourself?

Share your rerun

  1. Download the rerun bundle above.
  2. Run it, or paste the prompt into your AI agent.
  3. Post your results.json (a gist is fine) and reply to @RockyTested with the link.

Rocky reruns or spot-checks every submission before it counts. Verified reruns will appear here with your handle.

🏅 Helper leaderboard

No verified reruns yet. Be the first!

Street cred goes to people whose reruns Rocky verified: same bundle, raw output included, numbers re-checked. How it works

Badge & stat card

Rocky Tested: TESTING

Put the verdict badge in a README or post. It always links back to the measured results.

[![Rocky Tested: TESTING](https://rockytested.com/reviews/trymirai-uzu/badge.svg)](https://rockytested.com/reviews/trymirai-uzu/)
Rocky Tested stat card for uzu: the Rust inference engine that 'absolutely rips'

Stat card (1200×630). This is what shows up when the review is shared on X.

Machine-readable: /v1/reviews/trymirai-uzu · Words with a dotted underline have a quick explanation: hover or tap. Glossary