CityvettedHow we handle businesses with too few reviews to rank
Why a great new company can sit outside our top ten, and how we avoid rewarding volume for its own sake.
Some of the best contractors I have ever met have almost no online reviews. A two-person crew that stays busy on word of mouth, an electrician whose customers are loyal and quiet, a new business run by someone with twenty years of experience under another company's name: none of them generate the review volume that our scoring needs. So we face a real problem on nearly every list we build. What do we do with a business that might be excellent but has not left enough evidence to judge?
The wrong answer is to score them anyway. A 5.0 built on four reviews is not a 5.0. It is a coin flip with good marketing. The honest answer, and the one we chose, is to hold those businesses in a separate place and tell you exactly why.
- A high rating on a handful of reviews is statistically meaningless, so we do not rank it as if it were solid.
- Businesses below our evidence threshold go into an "Unranked" group, not a low rank. Thin data is not the same as bad data.
- We label them clearly so a great new business is not buried, and a thinly reviewed one is not oversold.
Why a tiny sample fools everyone
Picture a contractor with three reviews, all five stars. Now picture one with ninety reviews averaging 4.6. Most people's gut says the perfect score wins. The math says the opposite. Three reviews could swing to a 3.0 the moment a fourth customer has a bad week. Ninety reviews have already survived dozens of ordinary disappointments and held. Volume is not bureaucracy. It is how much weight the number can actually bear.
Cityvetted methodology, 2026.
Unranked is not a punishment
I want to be careful here, because "unranked" can sound like a verdict. It is not. It means we do not yet have enough to make a claim we would stand behind. A business in that group might be the best in town. We simply will not pretend our data proves it when it does not. Burying a promising new shop at the bottom of a ranked list would be its own kind of dishonesty, so we pull it out of the ranking entirely and present it as what it is: worth a look, not yet provable.
"We would rather tell you we do not know than hand you a confident number we made up from five reviews."
to Priya Anand, Deputy EditorHow to vet a thin-data business yourself
When the reviews run out, you fall back on the older tools, the ones people used before the internet ranked anything. They still work, and for a lightly reviewed business they matter more than ever.
- Ask for references.
Three recent customers, by phone, doing work like yours. A confident business hands these over without flinching.
- Check the license and insurance.
This is non-negotiable for anything structural, electrical, or plumbing. Verify it with your state, not just their word.
- Look for a track record under another name.
New business, experienced owner is a common and good story. Ask where they worked before.
- Get the estimate in writing.
Scope, price, timeline, warranty. Vague estimates are the reddest flag, regardless of review count.
None of this is glamorous, and none of it fits in a star rating. That is exactly the point. The Vetted Score is meant to do the heavy lifting when the data is rich enough to carry it. When it is not, we would rather hand you a flashlight than a false map. An unranked business is an invitation to do a little homework, and sometimes that homework turns up the best person on the whole list.
If you run a great business stuck in our unranked group, the fix is honest and slow: do good work, and ask happy customers to write it down. We will move you the moment the evidence does, and not one review sooner.