I’ve never look at consumer reports before purchasing something. In general people are horrible about self reporting and compartmentalizing issues. How do you weed out the guy who thinks his favorite brand can do no wrong or the Karen who just likes to complain to complain?
Go look at a review of a product on Walmart or Amazon and you’ll find people will give it one star because shipping company put it on their neighbors doorstep, and the neighbor took it. What the heck does that have to do with the quality of the toaster you bought? And then you’ll also find the five star review guy who says he’s been using XYZ product for 50 years and has their logo tattooed on his backside.
Neither of those folks should be taken seriously IMO.
I just took their annual survey a few minutes ago...first time in years (its rather long).
Note that the survey is primarily used for three purposes (from my observation of the questions and being a subscriber):
1) General satisfaction with the product
2) Reliability experienced
3) How you use the product...for example did you use certain features (or not use)...did you buy an extended warranty
Not sure how many members fill out the survey, but they claim 6 million members. I would suspect it has to be in the 100s of thousands.
Note that their reviews are performed by their staff, not by members. The membership survey is used seperately from their review to give you a general idea of expected reliability, and user satisfaction.
Like others, I find their reviews to sometimes be a mixed bag. I have been disappointed with the reliablity or satisfaction with some of their highly recommended products, but most times I am satisfied with my experience mirroring their review.
For most products, their are dozens of manufacturers and models, I do find their reviews helpful to narrow my search down to a handful, based on the features they point out as being useful, their review of its performance, and expected reliablity from users.
Lets face it, for example a car battery, we can't test every brand and model, but CR tests most. They point out the good ones and the turds. Even highly respected battery manufacturers have poor performing versions in some sizes...CR testing shows that. And they test several samples purchased from different locations around the USA. Really, no one else tests like they do, with large sample sizes...not even Project Farm.
