Back

Ranking Score Explained

Hey, thanks for your interest in how we calculate an experience's ranking score. It's at the core of Rankers so I'm pleased you're curious.

The ranking score percentage is used to compare and sort experiences in ranking tables. It is not necessarily a direct measurement of the quality of a particular experience as rated by its customers. I've found it a useful tool to allow me to find the best experiences with confidence. But I've also found it important to read the customer reviews before making any final judgements!

We calculate an experience's ranking score using a multi-factor data model instead of a raw data average (mean). This model takes into account several important questions. For instance - is there a trusted body of reviews? What is the age of a review and is the review from a credible source?

Below you'll find details around some of the important factors that went into calculating the ranking score for Kahu Kayaks.

If you have any questions or comments about our ranking score calculation please get in touch at info@rankers.co.nz. We don't believe this is perfect or complete so we're always interested in ways we might make improvements.

Cymen Crick's avatar

Cymen Crick

Rankers Owner

Kahu Kayaks

Valid Reviews

223 Valid Reviews

The Kahu Kayaks experience has a total of 224 reviews. There are 223 valid reviews that are included when calculating the ranking score and 1 invalid review that are excluded from the calculation. Reviews can be excluded only when a reviewer is not verified or after an investigation by our team determines the reviewer is not genuine.

Below is the distribution of ratings for the 223 valid reviews:

Rating Count Percentage
10/10 112
50%
9/10 62
28%
8/10 36
16%
7/10 9
4%
6/10 3
1%
5/10 0
0%
4/10 0
0%
3/10 1
0%
2/10 0
0%
1/10 0
0%

91.93% Average

The raw data average (mean) for all the Kahu Kayaks valid reviews is 91.93% and is based on 223 valid reviews. This value is not used to calculate the ranking score and it only provided here as a comparison to the weighted average.

Face-to-Face Reviews

174 Face-to-Face Reviews

The Rankers team meets with travellers while they’re in New Zealand and conducts face-to-face surveys. These reviews, in our opinion, are the most trusted in the industry and represent a critical control sample. To our knowledge, we are the only travel review website in the world that has gone to this extent.

More about face-to-face reviews

Within the 223 valid reviews, the experience has 174 face-to-face reviews collected during interviews by our team.

Below is the distribution of ratings for the 174 face-to-face reviews:

Rating Count Percentage
10/10 74
43%
9/10 55
32%
8/10 33
19%
7/10 8
5%
6/10 3
2%
5/10 0
0%
4/10 0
0%
3/10 1
1%
2/10 0
0%
1/10 0
0%

90.57% Average

The raw data average (mean) for all the Kahu Kayaks face-to-face reviews is 90.57% and is based on 174 face-to-face reviews. This value is not used to calculate the ranking score and it only provided here for comparison purposes.

Weighted Average

92.99%

Rankers calculates a weighted mean as a base average on which we can improve. Individual review's ratings are given a weight based on several factors. The weight of a review determines the overall impact it'll have on the final weighted average.

Recent reviews have more weight as they are more relevant and reflect the experience as it currently operates. Over time reviews become less relevant and loose their impact on the ranking score.

Low rating reviews carry slightly less weight. This dampens the effect of very low ratings for every experience across the board. This is especially important when the experience has few reviews overall and a single negative rating can grossly mischaracterise an experience. Consistent poor reviews will still result in the experience receiving a comparitively low ranking score.

Credible sources provide reviews that can be trusted. If we have verified a reviewer is genuine via a face-to-face meeting then the review carries additional weight.

Reviewer Rating Age Relative Weight
Kara 10/10 1387 days 100%
Seaghan & Dune 10/10 1477 days 75%
Pat Burns 10/10 2514 days 23%
Sabine Gauss 9/10 3237 days 14%
Rashi Birla 10/10 3257 days 13%
Alex Patteron 10/10 3297 days 13%
Marcel Felder 10/10 3333 days 13%
Tom Rogers 8/10 3336 days 12%
Olde Vogel 8/10 3336 days 12%
Lieke vol Velde 9/10 3336 days 12%
Katharina 8/10 3341 days 12%
Eurard Achille 8/10 3349 days 12%
Nickolas Jonkergouw 9/10 3365 days 12%
Miriam Gamble 9/10 3380 days 12%
Michelle O'Regen 10/10 3577 days 10%
Dahlia Ahmed 9/10 3600 days 9%
Lee Sandberg 10/10 3627 days 9%
Tina Rust 10/10 3628 days 9%
Alice and James 7/10 3646 days 8%
Chloe Guerillot 6/10 3651 days 7%
Christopher Rotsch 8/10 3685 days 8%
Tarillon Family 7/10 3965 days 4%
Charles Aubry 9/10 3997 days 4%
Arvid Hellquist 9/10 4007 days 4%
Damaris Mayer 8/10 4014 days 4%
David and Stephan 10/10 4044 days 4%
Devan Sheppard 9/10 4062 days 4%
Christina 7/10 4322 days 0%
Kathrin Lerch 10/10 4322 days 0%
Erik Nestlez 10/10 4323 days 0%
Nina Helmling 8/10 4338 days 0%
Steffen 9/10 4338 days 0%
Barbara 10/10 4352 days 0%
Marinette 8/10 4352 days 0%
Luca Scheuemeier 10/10 4352 days 0%
Kristina 8/10 4383 days 6%
Volker 8/10 4383 days 6%
jonas meier 9/10 4404 days 6%
Romina Bolz 8/10 4404 days 6%
Paul Balfour 8/10 4409 days 6%
Eric and Nienke 9/10 4430 days 6%
Julie Hatch 10/10 4491 days 6%
Rampon 9/10 4692 days 6%
Debiesse 10/10 4693 days 6%
Hendrik Rother 10/10 4696 days 6%
Claire 8/10 4705 days 6%
Jana Simcikova 10/10 4707 days 6%
Fabian Koitka 9/10 4725 days 6%
Michal Maly 8/10 4731 days 6%
JohnHyde 10/10 4764 days 6%
Aurelie Morin 7/10 4786 days 6%
Natalie Nubler 10/10 4787 days 6%
Anne Sutkowi 7/10 4795 days 6%
Sasha and Sandra Bonavia 9/10 4795 days 6%
Erik Funk 9/10 4802 days 6%
Harald Prinz 8/10 4806 days 6%
James Darren Tennant 10/10 4807 days 6%
scoopy 10/10 5039 days 6%
Goran Backlund 9/10 5055 days 6%
Tinne Cis 6/10 5067 days 5%
Richard and Janet 10/10 5073 days 6%
Michael Jefferies 10/10 5073 days 6%
Harald 10/10 5079 days 6%
Anne King 9/10 5079 days 6%
Matt Kelley 9/10 5079 days 6%
Lotte Zwail 9/10 5079 days 6%
Hannah Bean 8/10 5081 days 6%
Mike & Jennie 9/10 5081 days 6%
Mike & Mandy 8/10 5081 days 6%
pamr 8/10 5083 days 6%
Villa 9/10 5084 days 6%
Richard Spandonk 8/10 5087 days 6%
Franziska & Katrin 10/10 5091 days 6%
Clemens 10/10 5092 days 6%
Devon Urlacher 8/10 5093 days 6%
Thomas Krause 8/10 5093 days 6%
Lilja Bjork Hermannsdottir 7/10 5098 days 6%
Remy van Heugten 8/10 5098 days 6%
Keith_W 10/10 5099 days 6%
Annika 10/10 5099 days 6%
ToGy 8/10 5099 days 6%
Alfred & Henrike 10/10 5124 days 6%
Barbsldh 10/10 5130 days 6%
Deirdre Hayes 8/10 5167 days 6%
Cornelia & Josef 9/10 5173 days 6%
Fran & Roger 10/10 5178 days 6%
Mark Bakker 8/10 5178 days 6%
Gert 9/10 5191 days 6%
katel86 10/10 5252 days 6%
Martin Potter 9/10 5403 days 6%
Anezka Hlavacova 9/10 5419 days 6%
Dave Jones 9/10 5420 days 6%
Rolf 8/10 5427 days 6%
Wouter Moui 9/10 5428 days 6%
Canada 10/10 5428 days 6%
Michael Long 10/10 5429 days 6%
Beat & Connie 10/10 5430 days 6%
Jacob Nube 9/10 5432 days 6%
Andy Cameron-Daniels 10/10 5434 days 6%
khs 9/10 5436 days 6%
Ann Parry 10/10 5440 days 6%
Adam Hayley 7/10 5448 days 6%
Katie Nicol 10/10 5449 days 6%
Darren Bruestle 9/10 5451 days 6%
Tom 9/10 5454 days 6%
Russell Stevens 8/10 5454 days 6%
Philipp Rau 9/10 5455 days 6%
Luc Marchand 10/10 5456 days 6%
Julia 10/10 5456 days 6%
Leslie Aldridge 10/10 5457 days 6%
Jorgen vahl Rasmussen 9/10 5457 days 6%
pjfranke 10/10 5464 days 6%
Beate Godsk 9/10 5464 days 6%
Bunthorne 10/10 5495 days 6%
emthekiwi 10/10 5587 days 6%
Demmers 10/10 5679 days 6%
Phineas Smith-Fox 9/10 5737 days 6%
wilsoneng 10/10 5770 days 6%
Maria 9/10 5770 days 6%
Tim Smith 10/10 5792 days 6%
BenH 10/10 5801 days 6%
Flora 10/10 5803 days 6%
Vera Van Schie 10/10 5809 days 6%
Thomas K 9/10 5810 days 6%
Jannievan Osnabrugge 10/10 5811 days 6%
Helen B 9/10 5811 days 6%
Ferth 10/10 5815 days 6%
Roos 9/10 5815 days 6%
Klass 9/10 5815 days 6%
Hannah Clark 10/10 5822 days 6%
Ingrid Overes 10/10 5828 days 6%
Tracey Buschl 10/10 5829 days 6%
Mitchell Mapletree 10/10 5845 days 6%
Maki 10/10 5860 days 6%
nigelwaterhouse 9/10 5860 days 6%
Ed 10/10 5860 days 6%
Dogmatix 10/10 5860 days 6%
sophiep 9/10 5875 days 6%
biene 10/10 5875 days 6%
Susann Koschmeider 10/10 5895 days 6%
Karen Raven 8/10 5898 days 6%
Eimear Doyle 10/10 5903 days 6%
Ton Buil 9/10 5903 days 6%
amzbellz 10/10 5952 days 6%
Kurt Smudzinski 10/10 5982 days 6%
bertel 10/10 6018 days 6%
desl 10/10 6135 days 6%
martinat 10/10 6135 days 6%
Van Lent 8/10 6136 days 6%
S Schlesinger 10/10 6139 days 6%
Andrew Smith 9/10 6141 days 6%
BevanLisa 9/10 6152 days 6%
Barry Smith 9/10 6155 days 6%
Mia 10/10 6156 days 6%
Soeren Rasmussen 10/10 6157 days 6%
eatc 10/10 6166 days 6%
A 9/10 6166 days 6%
Charles 8/10 6167 days 6%
Dalibor 10/10 6169 days 6%
ChristopherD 8/10 6169 days 6%
CarolB 10/10 6169 days 6%
Emma Louise 9/10 6178 days 6%
Christina 8/10 6183 days 6%
Rachel 10/10 6184 days 6%
AlastairP 10/10 6192 days 6%
mike smith 10/10 6192 days 6%
Caroline 9/10 6192 days 6%
Busson 8/10 6197 days 6%
Hans 7/10 6199 days 6%
Nicole 10/10 6199 days 6%
Tanja 10/10 6199 days 6%
Dianne 9/10 6203 days 6%
LeaM 9/10 6205 days 6%
AndreM 10/10 6205 days 6%
JohannesE 7/10 6205 days 6%
Bernd 10/10 6205 days 6%
KTinga 9/10 6206 days 6%
Lucas 10/10 6207 days 6%
Josefine 10/10 6207 days 6%
alex 10/10 6207 days 6%
Richard Rodd 10/10 6213 days 6%
rar 10/10 6213 days 6%
Melanie 10/10 6215 days 6%
Katherine 10/10 6239 days 6%
Claire 9/10 6247 days 6%
Tim 10/10 6255 days 6%
Maureen 10/10 6255 days 6%
lming60 10/10 6260 days 6%
peter_lowles 10/10 6265 days 6%
mike brett 8/10 6269 days 6%
RhysandSteffi 10/10 6285 days 6%
Paula Semmens 9/10 6293 days 6%
StephR 10/10 6294 days 6%
Rudolf Meredith 10/10 6295 days 6%
Max 9/10 6370 days 6%
Rhea 9/10 6443 days 6%
annemarie_and_markus 10/10 6486 days 6%
charlotte 9/10 6507 days 6%
jahirst 10/10 6517 days 6%
Liz 9/10 6518 days 6%
Barnie 10/10 6521 days 6%
Christine 10/10 6521 days 6%
Kolacny 10/10 6521 days 6%
Mie Toft Pedersen 9/10 6531 days 6%
Emily Houston 10/10 6532 days 6%
Dirk 10/10 6534 days 6%
Ian Ridgeway 10/10 6536 days 6%
Loodle 9/10 6546 days 6%
Zurcher Marco 3/10 6562 days 3%
Anna 10/10 6575 days 6%
Hugh McCarthy 6/10 6582 days 5%
Tony and Ken 10/10 6582 days 6%
Anneli 8/10 6583 days 6%
holly parker 10/10 6593 days 6%
Vince 10/10 6602 days 6%
Lena 10/10 6613 days 6%
Carolr 9/10 6624 days 6%
MarkReid 10/10 6825 days 6%
Hazel 9/10 6859 days 6%
Magnus 8/10 6865 days 6%
Katie 10/10 6868 days 6%
Heather 10/10 6872 days 6%
Jacob Mille 10/10 6879 days 6%

Adjustments

Several adjustments to the weighted average are added to improve relevancy and credibility. These adjustments apply equally to all experiences that meet the criteria.

Sample Size Adjustment

No Adjustment

A reasonable number of reviews are necessary in order for the average to be credible and for an experience to take a prime position within the ranking tables. As such, experiences with only a few reviews have a moderated score. This does not mean that the experience or the reviews can't be trusted. The Kahu Kayaks experience has plenty of reviews and does not meet the criteria for any adjustment.

Recent Reviews Adjustment

-4.09% Adjustment

There may be an adjustment if this experience hasn't received any reviews within the last 46 days. However the Kahu Kayaks experience does not meet the criteria for any adjustment.

In addition, an experience's ranking score may be adjusted for each day there is no new ranking. After 1 day the adjustment comes into effect. The maximum number of days that can be adjusted for is 200 days. Due to the seasonal nature of many businesses, this adjustment is applied dynamically throughout the year.

The Kahu Kayaks experience has been adjusted for 200 days. Adjustments are according to the following table.

Days Adjustment
… …
197 -4.03%
198 -4.05%
199 -4.07%
200 -4.09%
201 -4.11%
202 -4.13%
203 -4.15%
… …

Balancing Adjustment

1.15% Adjustment

Every experience's review score is adjusted to balance out the disproportional number of negative reviews that are contributed.

You won't be surprised to learn that disgruntled customers are more likely to leave a review than happy ones. They are motivated to share their experience and warn others. We consider this a good thing and it's why reading the reviews is important. However we've learned it can misrepresent the experience in a more overall sense.

We apply a balancing adjustment to counteract this effect and ensure the ranking score is a more fair representation of the experience. This adjustment is applied equally to all experiences.

Final Ranking Score

90%

The final ranking score once any adjustments, ratings, and rounding has been applied. This value is recalculated each day and a short rolling average is applied. Therefore it may not be precisely accurate based on the other values presented.