How Rankquant handles natural wines in review aggregation

By Ryan Siegal · Founder and Principal

Published 2026-04-23

Why natural wines are a methodology test

Natural wines — wines produced with minimal intervention, native yeasts, minimal or no sulfite addition — have become a substantial category in the last 15 years. They're particularly strong in Loire Valley whites, Jura, Beaujolais, and increasingly New York, Oregon, and California.

They pose three distinct challenges for aggregated scoring:

Thin professional coverage. Wine Spectator, Wine Advocate, and Suckling cover natural wines less comprehensively than conventionally-made wines. Decanter and Jancis Robinson cover them more. CellarTracker and Vivino cover them substantially.
Stylistic polarization. Some professional critics penalize natural wines for stylistic choices (brettanomyces, volatile acidity, unfined cloudiness) that the natural-wine community considers features rather than flaws. The same wine can get 88 from Wine Spectator and 16/20 from Jancis Robinson.
Category growth outpacing coverage. New natural-wine producers enter the market faster than professional critics can cover them. The review-coverage gap widens year over year.

How Rankquant handles it — principle by principle

1. Natural wines aren't their own category

We don't create a separate "natural wines" peer set. A natural Burgundy Chardonnay is compared against other Burgundy Chardonnays in its price tier and vintage — conventional and natural alike. This prevents the stylistic-polarization problem from distorting the score: we don't create an artificially-friendly or artificially-hostile peer set.

2. Bayesian adjustment protects thin samples

A natural wine with two professional reviews (say, 17/20 Jancis and 86 Wine Spectator) and 400 Vivino reviews averaging 4.2 gets appropriate treatment under the Bayesian prior. The adjusted mean is pulled toward the peer-set prior until enough data exists to justify a distinctive score. Over time, as coverage grows, the score sharpens.

3. Crowd source weights are honest, not deferential

Vivino weight 2 and CellarTracker weight 3 apply equally to natural and conventional wines. We don't up-weight crowd sources for natural wines just because the community is more engaged there. That would be a hidden advocacy bias; we don't do advocacy biases.

4. Stylistic disagreement is surfaced, not hidden

When Rankquant detects large disagreements between weighted sources (e.g. Wine Spectator 86 vs Jancis Robinson 17/20 = 85 rescaled, vs Vivino 4.4 = 88 rescaled) we flag the wine as stylistically polarizing on the product page. Readers see both the blended normalized score and the flag that indicates the wine divides its tasters.

Natural wines aren't a rating problem — they're a transparency problem. Show readers when sources disagree and let them decide whose palate to trust.
— Rankquant editorial approach

What this means for the natural-wine reader

If you're specifically looking for natural wines on Rankquant:

Use filters, not separate category scores.Filter the category hub for wines tagged "natural" after sorting by normalized score. The wines that surface will have earned their score against mixed-style peer sets, which is a stronger signal than a natural-only peer set would provide.
Look for the "stylistically polarizing" flag.If a natural wine has wildly-divergent source scores, the flag tells you to read individual reviews before buying. The blended normalized score isn't misleading, but the spread behind it is informative.
Prefer wines with ≥ 3 weighted sources. Bayesian adjustment pulls thin-sample wines toward the peer-set mean, which means a two-review natural wine will score close to its category average rather than reflecting the (potentially high) individual reviews. Three or more sources gives you a sharper score.

What we won't do

A few explicit non-choices that reflect our commitment to methodological rigor:

We won't apply a "natural bonus" to scores.Some retailers and curators do this implicitly. We don't — the weighted mean + Bayesian + z-score treatment is the same for all wines.
We won't down-weight professional critics who penalize natural styles.Their editorial rigor is what earned them the source weight in the first place. Disagreement with the natural-wine community is a data point, not a failure.
We won't maintain a "natural-wine score" separate from the normalized score.That would be two scoring systems and therefore no scoring system.

Frequently asked questions

Does Rankquant penalize natural wines?+

No. Natural wines are normalized against their style × grape × region × vintage × price peer sets just like any other wine. If a natural wine scores lower than its peers on weighted-mean terms, that reflects its individual reviews — not any Rankquant bias.

How does Rankquant know which wines are natural?+

We tag wines using production-declaration data from producer websites (for small imports) and retailer category tags (for wines sold through specialty importers like Selection Massale, Louis/Dressner, or Jenny & Francois). "Natural" isn't a legal category so tagging is editorial, not algorithmic.

What about orange wines and other emerging styles?+

Orange wines (skin-contact whites), pét-nat sparkling, and other emerging styles are normalized the same way — peer sets are defined by style + variety, and we'll split out dedicated peer sets only when a category grows large enough to support n ≥ 30 independent wines in a given vintage × price slice.

Will Rankquant cover cloudy / unfiltered / high-VA wines fairly?+

We don't have the authority to say what's "fair" for a stylistic choice — professional critics disagree on exactly this question, and our methodology respects both camps. What we commit to: transparency. Every wine's source-level review data is visible, so readers can see exactly which critics loved it and which found fault.