to score or not score, that is the question...

56 Replies
K S said

I stopped rating for a short time then started up again when I decided I don’t care what others thought of my rating system. The fact Steepster uses a 100 point system automatically takes me back several decades to high school. 65 and below was an F. 95-100 was an A. Most teachers graded on a curve.

It may be intended here that an average tea is a 50. I can’t wrap my brain around that. I am not sure Steepster’s system really does either as a tea with one review will usually show as an averaged score of around 77.

I did manage to do some altering in my mind so that an average tea bag starts at 65 and average loose leaf starts at 75. A company really has to blow it to score less with me. I see a B as 80-89 and an A as 90-100.

alice said

I didn’t work on a point system in school except for multiple choice exams, even a lot of our maths exams were graded against a criteria sheet rather than a point system. I suppose that does influence how I look at point systems.

I doubt I’ll ever rank a tea 100 because I like to think of the 100 point scale as a line up of my favourite teas where 100 is the non-existant perfect tea. I often go back and adjust my rankings after I experience something that changes how I understand the genre because my rankings are primarily for my reference rather than for other people.

In some ways it might be nice to be able to rank teas on individual criteria such as value, taste, aroma, etc but I don’t think it would add that much because tea preference is so personal.

Login or sign up to post a message.

To be honest, I don’t look at the ratings of a tea if I’m considering trying it. I look at the reviews and what people’s experiences with the tea have been. Mostly because ratings are just other people’s numbers and have little meaning to me.

That being said, and at the risk of repeating what alot of the people here have already said, my ratings are for myself. If I don’t like a tea, I’ll rate it accordingly. I have my own scale that I use, and if I rate a tea low it’s so that I can either A – avoid whatever was in it or what kind it was, or B – depending on the rating, try to find another version/blend/brand/etc of the same type of tea that I might like better. I don’t add ratings on a tasting note so that other people can use them to determine their own ideas about said tea. And I don’t really worry about if there’s someone who might not agree with the fact that I’ve rated a tea low (or lower than eveyone else seems to have) because I didn’t like it. I have the right to my own opinion and the person can skip over that opinion if they don’t like/agree with what I’ve said. In fact, I’d encourage it because tea drinking is supposed to be a relaxing experience and getting worked up over a low rating or review kinda defeats the purpose. Lol.

Yes. This is how I feel about ratings. :)

Login or sign up to post a message.

JustJames said

my reply is MY opinion.

i decide whether i will assign a numerical rating to a tea or not. the circumstances under which i MAY not: 1) i had a very small sample and can’t try it again. 2) i suspect it may have been operator error. 3)i deliberately bought a sample i suspected i wouldn’t like in order to try the ingredients in a different way.

in my profile i am specific about my ratings: a high rating may NOT reflect liking it… you can respect something without liking it. i feel an accomplishment is worthy of recognition. the teas i truly like are unmistakeable: i use enormous metaphors, add links to pictures and youtube songs and am generally boisterous. either way i am always specific about why.

sometimes i rate, other times i don’t. it’s my cup of tea, my palate and my call. of course i say that good naturedly… everyone is allowed to rant and i would never suggest otherwise. just keeping things transparent is all.

Angrboda said

it’s my cup of tea, my palate and my call.

This, in a nut shell. :)

Login or sign up to post a message.

JustJames said

@Angrboda candor saves time.

Login or sign up to post a message.

Bonnie said

I think I should stop here because my point isn’t being understood.
Of course everyone has a right to do and say what they want about the tea they’ve been drinking. But, to be oblivious to how this may effect the success of a tea company by one’s careless whims seems to me counter to what the humility of tea is about. I too have given a few reviews less favorable in the past several years but not without suggesting a correction.

Login or sign up to post a message.

JustJames said

my dear bonnie… i was replying only to the original post and the tone in which it was written, not to any other reply. and of course you should be speaking here, you’ve been here longer than any of us. (and you’re awesome) (with adorable grand babies) (and have a cool website… although i would be allergic to the incense).

everyone has their own system on here, numbers for keeping track of whether they want to buy, numbers to tell the vendor what they think, no numbers because they’re more alpha than numeric. everyone has their own reasons… you and terri don’t assign numbers, i usually do… and neither is wrong.

YES i am aware that my review (as with anyone else’s) can affect the success of a tea. however— i certainly would never try and tank the success of either a vendor or tea. that said the onus on the vendor to impress me with their product.

i have spent so much time in customer service. i learned a long time ago that without candor and sometimes criticism (numerical or verbal) you do not get better. if you listen to your public you become more refined, as does your understanding of what your consumers want (which is imperative for all companies/vendors/people that work selling stuff to other people). for me even a negative is all about the betterment of the tea and the vendors.

this place is supposed to be a safe forum. we can vent, we can be opinionated, we can love tea and cheer it on because it is superlative… what is less helpful is if any individual is criticizing how members choose to function within the safe forum. while i usually stay out of politics, weighing in here was appropriate.

Bonnie said

It not my intention to attack, but to point out the big picture too. You haven’t been here when outsiders come to attack tea companies or individuals here on steepster. People who hate us all! I for one have fought back, other’s have too! I wanted to get off my chest how I feel about not respecting tea, and I did. That’s enough. It’s not just how I feel about tea, but my goal about everything.

Login or sign up to post a message.

Oh gee, I’m almost afraid to rate teas anymore because of all the fuss it causes around here. However, I strongly depend on my ratings to keep track of teas as after a while, I forget what I liked or didn’t like (and scanning through logs is way too inefficient). I am not a tea connoisseur nor are many of the other users here. I would not necessarily recognize “quality” in one tea over another according to written standards, but I know what I like. Sometimes, I prefer the taste of a cheaper less gourmet version of a type of tea. What keeps sales going for tea companies isn’t how top-of-the-line their teas boast of themselves, but whether or not the majority of untrained palates out there like them enough to buy again.

I am another who doesn’t use rating alone as a deciding factor to buy or not buy tea. There are sooo many teas that I love that have low ratings on steepster. I’d like to believe that most of us are smart enough to make such informed decisions too.

For the most part, I don’t get the impression that the rogue “I hate earl grey so Im rating this low” note has a major influence on the success of a tea. I can sort the teas by rating on this site and the bulk of what shows up first really are the premium top-of-the-line teas and vice versa if I search through lower-rated teas I see what I expect to see there too.

I don’t mean at all to offend anyone by this reply or by my use of ratings. Everyone here has a valid point, but until the rating system has clear set guidelines defined by the site admins, the argument is largely moot. As long as these rules don’t exist, it seems silly to be telling each other the “right” way to do things. I personally would like to have the option to set my ratings to private so that I can use them for my purposes and not feel bad about my personal tastes and untrained palate.

Dr Jim said

The key issue for me is the fact that “the bulk of what shows up first really are the premium top-of-the-line teas”. I often look at a single company’s teas to help me place an order, but ALWAYS read the text, since there are certain styles that I’m not wild about. The numbers are helpful, but not a be-all, end-all

TeaLady441 said

Don’t be afraid to rate! Do it for yourself, and don’t worry about other people criticizing.

TeaLady441 said

I have opinions on how we should use the rating system, but I just wanted to get out there – people shouldn’t be afraid to use it for fear of criticism. It’s not a perfect system, but it works the best that I can think of, and the reviews themselves mean more than the number anyway.

Login or sign up to post a message.

JustJames said

this post is beginning to disturb my calm.

i see friends justifying why they choose to rate or not to rate when they shouldn’t have to. people are arguing with one another over history, calling one another out.

zahikanaan, i must ask: did you intend this upset or were you hoping for a healthy discourse that spiraled away from your vision? reexamining one’s intent, debate, a healthy give and take of information; these are all beneficial. initially your rant prompted that reaction, but my literacy does not read it as such at this point.

this a passionate forum, filled with intelligent, passionate people that come from many cultures and walks of life… here we are united by our mutual appreciation of tea. we are musicians, writers, mathematicians… in so many ways we are disparate… but our presence here connects us.

we are here because we have found a community. not a one of us needs to justify that, nor explain our comportment within it.

za-hi said

i didn’t mean to offend anyone, or cause a riot. i just wanted a solution to a flaw in a system. i honestly don’t get how people are reading my post the wrong way….

JustJames said

zahikanaan, i wouldn’t ever speak on someone else’s behalf. for my part it was two things:

1) this is an open forum. you can rate how you like without having to explain. you can rant… aside from a few very basic rules about inappropriate comments this is an open space: you can rate your day while you rate your tea and if you mention that you had a root canal people you have never met will commiserate. being critical of people you barely know in a forum that you’re newish to may not have been the best opener IN MY OPINION.

2) that said, i’ve stirred the pot before, not on purpose, just didn’t think about it at the time. HOWEVER, when i see friends getting upset then i become bothered.

we all have a story, we have history… this is one of the few places in the world (physical or virtual) where i can be myself, where i have friends that care because they want to, without knowing a thing about me. steepster is a very generous community. we are good people. i am protective of it, as are many of us.

the one downside is that it is an online community… which means you’re reading posts and applying your own intracranial tone of voice to someone else’s writing, which is the bane of many online communities.

what say we put aside miscommunication and be friends?

za-hi said

i’m down like a clown with his frown upside down.

JustJames said

BUWAHAHAHAHAHA!!!

Login or sign up to post a message.

Zeks said

It’s very simple really – if there were no scores on steepster, I’d never pick a lot of amazing teas I am enjoying here. So, definitely score.

Login or sign up to post a message.

alice said

I find it kind of hard to believe that a tea can have over 100 reviews and score over 90 without some kind of bias. To me the joy of tea is that there is no perfect tea and there are so much variety that there is something for everyone.

I think I’m more skeptical of teas that consistently have nothing but high scores from lots of users than I am of teas that have average scores or a couple of really low scores.

Angrboda said

That’s a good point. Positive bias may look better than negative bias, but it’s still bias. There’s just no possible way to avoid it.

JustJames said

hmmm, i have been known to rate a tea as a 100. but that is a personal basis. FOR ME i cannot imagine it better than it is. it is superlative TO ME, i can think of no way to improve it. i have no criticism.

i very deliberately do not read reviews of what i am drinking, nor look at numbers… to my reasoning that reduces the likelihood of a positive bias, but there are still vectors through which i could be influenced.

i also have done away with the idea that ‘there can be only one" (cue lightning from highlander)… under my personal rating parameters i can have any number of 100’s.

i understand your skepticism though… i have a constant ‘prove it’ in my brain when everyone is shrieking about how amazing something is.

Angrboda said

I agree, 100 points doesn’t necessarily mean that ‘this is the most perfect tea in the whole world’, it just means that it’s a very good tea and I can’t think of any aspect of this particular tea that I would change if I could.

Zeks said

Laoshan black for example can easily accumulate >100 over 90s. It is that good.

alice said

Unfortunately I will probably never know about the Laoshan black as verdant don’t ship to Australia. Maybe I’m just bitter because most of the high ranking teas come from vendors who won’t ship to me, ha!

Dr Jim said

I have the opposite approach. I assume that there are teas out there that are better than the ones I have tasted, so I save some head-room in my rating for those as yet unknown better teas. The highest rating I have ever given is a 94. I was also a tough grader when I was teaching.

Sil select said

Genu-if you like, I’m happy to pull together a mini package and send it to you of things like laoshan black…unless you don’t want to taste them for fear of loving it and not being able to get it except via tea friends heh would happily do some sort of Australian swap

infused1 said

I have two teas rated at 100 right now. They’re likely not the highest quality teas in the world (one’s not even a tea – it’s a tisane), but they’re the ones I reach for all the time.

Uniquity said

Hey, if they’re 100s to you, have at ‘er. I was much more generous with my ratings when I started here so my top rated teas tend to be ones I haven’t had in ages and probably wouldn’t like as much now, but at the time they deserved it!

Login or sign up to post a message.

Login or sign up to leave a comment.