You're about to hire someone to fix your roof or renovate your kitchen, so you pull up Yelp and sort by "Best." The results look promising, filtered and ranked by the algorithm. But here's the uncomfortable truth: those "best-of" lists aren't built to find you actual quality, they're built to show you businesses that play the Yelp game best.
Yelp's "Best" filter doesn't directly measure whether a contractor will show up on time, finish your job right, or stand behind their work. Instead, it's a weighted combination of review count, recency, rating, and what Yelp calls "review reliability." That last part is key. Yelp's algorithm is designed to filter out fake reviews and catch manipulation, which sounds protective until you realize what actually happens: businesses that are organized enough to game the system often rank higher than truly exceptional contractors who've never learned to manage their online presence.
A five-star contractor with 12 reviews might legitimately be better than a 4.8-star contractor with 200 reviews. But Yelp's algorithm almost always favors the second one. The software is filtering for signal-to-noise ratio and authenticity markers, not for actual quality of work.
Here's what actually happens: the contractors who appear at the top of Yelp's "Best" lists are frequently the ones who've been on Yelp the longest, have the most reviews, and have learned to encourage their satisfied customers to leave feedback. These are often chain operations, franchise locations, or contractors who've made online reputation management a business function.
This creates a structural advantage that has nothing to do with being the best at their trade. A family-owned electrical business that's been in your town for 30 years but joined Yelp three years ago will lose the ranking battle to a newer competitor with 15 more reviews, even if the family business gets better results.
The consequence is that you're seeing what's popular and established, not what's actually best. Those are sometimes the same thing. Often they're not.
When you hire someone based primarily on Yelp reviews, you're making a decision based on a popularity contest. But here's what should actually determine your hiring choice:
None of this gets captured in a Yelp review. A contractor could have 200 five-star reviews and still be overpriced, disorganized, or have spotty work. A contractor with 15 reviews could be exceptional but just hasn't been on the platform long enough to break through. You're filtering by noise instead of signal.
Yelp has a built-in incentive problem that most homeowners don't see. The platform makes money when businesses advertise on it. Yelp's sales team has historically been aggressive about this, sometimes using review visibility as an implicit lever. The company has settled lawsuits claiming extortionate practices, though Yelp disputes the characterization.
The point isn't that Yelp is corrupt. The point is that the incentive structure doesn't align with helping you find the best contractor. It aligns with keeping businesses engaged and spending money on the platform. When a contractor sees their "Best" ranking drop, or their average rating dip, they become more likely to invest in advertising, review management software, or both.
You're the one paying for that, indirectly, through higher contractor prices.
Real hiring decisions aren't made on Yelp. They're made through referrals, neighborhood networks, and direct conversations. If you ask ten neighbors in your area who they'd call to re-roof their house, you'll get better information than Yelp's algorithm can provide. Those referrals come with context, accountability, and actually speaking to someone who had the work done.
This is where the disconnect happens: Yelp is designed for the first decision, not the final one. It's designed to help you discover options you didn't know existed. But by the time you're actually hiring, you should be relying on:
This takes more time than sorting by "Best" on Yelp. But it works.
The contractors who appear at the top of "Best" lists often deserve to be there, but not because the algorithm identified quality. They're there because they've been visible on the platform long enough and managed their reputation aggressively enough to break through. That's not a bad thing, but it's not the same as being the best.
A better approach: use review sites as one data point among many, not as the primary filter. Read recent reviews to catch red flags, look for patterns in feedback about specific things that matter to you (communication, timeliness, follow-up), and then move into direct outreach. Call three contractors. Ask them the same questions. See who responds fastest and most thoroughly. That's where you'll find quality.
Yelp's "Best" lists are optimized for something, but it isn't finding you the contractor who'll do the best work on your home. The algorithm doesn't have enough information to make that judgment, and the incentive structure works against you anyway. You have to do the work yourself, armed with better questions and a healthy skepticism toward any list that claims to have already done the filtering for you.
Get more like this in the weekly letter, subscribe at /.
← All posts