Originally posted on Paragraph on April 4, 2026.
Paste a prompt. Get an optimized version. Ship better work.
Every AI model you're using is better than you think.
Your prompts are the bottleneck.
I've been building OnChainIntel, an AI-powered crypto wallet behavioral analysis tool for the past several months. Every piece of content we produce runs through LLMs for analysis. And the single biggest lever on output quality isn't which model we use. It's how precisely we instruct it.
The problem: until now, there has been no standardized way to measure prompt quality. No CPM equivalent for prompts (example from the advertising industry). No cited framework that a non-technical user could apply.
So we built one.
What is Prompt Quality Score, PQS?
PQS is the world's first named AI prompt quality score built on cited academic research and industry evaluation frameworks.
It works in two layers:
Prompt-side scoring: how well-constructed is your input?
Specificity: does the prompt define what it wants precisely?
Context: does it give the model enough to work with?
Clarity: are the directives unambiguous?
Predictability: would different runs produce consistent results?
Output-side scoring: how good is the result?
Completeness: did the output cover what the prompt implied?
Relevancy: is it answering the actual question?
Reasoning depth: does it demonstrate structured thinking?
Faithfulness: does it stay grounded in what was asked?
Each dimension scored 1–10. Total out of 80.
8 attributes. 5 frameworks. 1 score.
The Proof Layer
Here's what makes PQS different from every other prompt optimizer.
We don't just rewrite your prompt and tell you it's better. We run both, the original and the optimized version, and then show you the actual outputs side by side.
The output difference is the proof. No trust required.
Real example from today:
Prompt: "who are the smartest wallets on solana right now"
Original output: a generic list of known whale wallets. No entry signals. No behavioral context. Nothing actionable.
Original PQS score: 9/40
Optimized output: token age under 3 days, fewer than 500 holders, top 10 wallets holding under 30% of supply, $50k+ 24h volume. For each candidate: contract address, holder count, wallet concentration, and one behavioral signal indicating smart money entry.
Optimized PQS score: 35/40. +84% improvement.
Same model. Same API. Completely different output.
The Frameworks Behind it
PQS is not opinion dressed up as a number. Every dimension traces to a cited, peer-reviewed framework:
PEEM (Prompt Engineering Evaluation Metrics) was published March 11, 2026 by Dongguk University. The first academic framework for joint prompt and response evaluation. Validated across 7 benchmarks and 5 task models. Showed that PEEM-guided rewriting improves downstream accuracy by up to 11.7 points, outperforming supervised and reinforcement learning baselines. Three weeks old. Nobody has built a product on it yet. Until tonight.
RAGAS evaluates faithfulness, answer relevancy, and context precision. Used in production pipelines at teams running Claude, GPT-4o, and Gemini.
MT-Bench LMSYS multi-turn benchmark. GPT-4 scores showed >0.8 correlation with human ratings. Industry standard for evaluating reasoning quality.
G-Eval LLM-as-judge framework using chain-of-thought reasoning. Improves scoring reliability by 10–15% over direct scoring.
ROUGE the original NLP completeness metric. Used in summarization evaluation since 2004.
PEEM · RAGAS · MT-Bench · G-Eval · ROUGE
First time applied at the consumer level.
Why now?
Three reasons this matters right now:
The tooling is developer-only. Every prompt evaluation tool that exists — LangSmith, DeepEval, Opik, RAGAS, etc. requires Python, datasets, and engineering setup. There is no consumer-facing product with a named quality score. PQS is that product.
The academic work just landed. PEEM was published March 11, 2026. It is the most rigorous prompt evaluation framework ever proposed and it has not been turned into a product. We built on it first.
The market is massive and extremely underserved. Prompt engineering is a $1.5B market growing at 32% CAGR. Every tool serving it is aimed at developers. The consumer layer did not exist until tonight.
The Defensibility Question
Someone will ask: is this really the first?
Here's the honest answer.
Academic frameworks exist: PEEM, ROUGE, G-Eval. Developer tools exist: LangSmith, DeepEval. None of them have produced a named, consumer-facing, citable prompt quality score with a methodology anyone can reference and build on.
PQS is not a product feature. It's the first serious attempt by anyone to create a named AI prompt quality score.
We're not claiming it's perfect. We're claiming it's first. And we're making the methodology open so anyone can improve it.
The Open Standard
The methodology is public. The 8 dimensions, the 5 source frameworks, the scoring rubric. All of it is documented and open.
If you want to implement PQS scoring in your own tools, do it. If you want to cite it in research, cite it. If you want to build on it, build.
That's the model. Open methodology creates adoption. Adoption creates the standard.
The standard makes the data more valuable for us all.
Try it --> https://pqs.onchainintel.net
Paste any prompt. Select your vertical. Hit submit.
On-chain analysis is the default — tuned for wallet research, token signals, DeFi queries, and behavioral analysis. Crypto content, market research, and general modes also available.
Screenshot your before/after. Tag us @OnChainAIIntel.
What's next
Cross-model scoring —> same prompt through Claude and GPT-4o simultaneously, scored by a third model as judge. Shows you not just a better prompt, but which model executes it best.
PQS Leaderboard —> weekly rankings of the highest-scoring prompts by vertical. Published publicly.
PQS Whitepaper —> full academic-style documentation of the framework, to be submitted to arXiv within 30 days.
PQS API —> so other tools can integrate the standard and display PQS scores natively.
If this post was useful, please consider subscribing as we’ll have weekly wallet analyses and posts about everything OnChain.
About OnChainIntel — AI-powered on-chain wallet analysis. We decode the behavioral patterns, hidden biases, and implicit bets behind any wallet's transaction history. Try it free at onchainintel.net · Follow us on X: @OnChainAIIntel · TikTok: @onchainintel · YouTube: @OnChainAIIntel
1: https://paragraph.com/@*Emails are not allowed*/introducing-pqs-the-worlds-first-named-ai-prompt-quality-score
