Home U.S. Coin Forum
Options

CW Test of grading services: Waste of time and effort?

This week's CW reports on a blind test of 8 grading services. Fifteen different coins were submitted to each service over the course of the past year.

Unfortunately, it appears that an astonishing number of coins submitted, 11 of the 15, were mishandled, whizzed, or cleaned in one way or another, while the none of the remainder were gems. Therefore, the value of this test for many of us is essentially useless, as these are not the kind of coins we tend to submit for grading.

As you might expect from this "sample", most of the pieces were acquired raw. One reason probably is that the owners knew what these coins were, and such pieces are not good candidates for any of the grading services. That's about all this test revealed -- it confirmed what most of us knew already.

Why a more reprentative sample was not not selected is beyond me. It would have been really interesting to see how the services differed when grading nice coins, not the dreck chosen. It's almost as if the sample was chosen purposely not to reveal too much information about the grading services.

Comments

  • Options
    MrEurekaMrEureka Posts: 24,072 ✭✭✭✭✭
    Yes, a COMPLETE waste of time and effort!

    Of course, someone may be inspired and do it right next time...

    Andy Lustig

    Doggedly collecting coins of the Central American Republic.

    Visit the Society of US Pattern Collectors at USPatterns.com.
  • Options
    newsmannewsman Posts: 2,658 ✭✭✭
    Gemtone,

    Here's my two cents'worth:

    You might have noticed them saying they picked the coins from test buys performed on their advertisers, which begs the question: Why are their advertisers selling so many whizzed, cleaned and altered coins and getting away with it?

    Also, it's interesting to see that PCI seemed to be the service most unable to spot problem coins - even worse than ACG.

    Maybe it wasn't a complete waste. imageimage

    Chuck
  • Options
    MarkMark Posts: 3,527 ✭✭✭✭✭
    Newsman (Chuck):

    I realized the exact same two points you made. I guess great minds think alike! image Personally, I thought emerging the worst off from the report were PCI, ACG, and Coin World.

    I think a valuable additional report would take 10 or so high-graded MS and PR coins and resubmit them 5 or more times to various slabbing companies. In this way you could check the consistency of the various services: Does PCGS always grade a particular coin MS66 or what is the range of the grades? I think that it's consistency that is a major issue with the grading companies. For instance, if PCGS and ICG are both perfectly consistent and say ICG is 1 point higher than PCGS, then there is very little difference between PCGS and ICG. In that case, an ICG MS67 = PCGS MS66 and the prices would perfectly reflect this difference. Obviously the services are not totaly consistent, which is why the crack-out game is so profitable, but I would be very interested to know which of the major services is the most consistent and which is the least.

    Mark
    Mark


  • Options
    It was a test of a number of factors in the coin market - buying from dealers in Coin World sight unseen, graders, and grading services, to name a few. I know graders sometimes move around - did any get to grade their coin twice?

    Would you buy from a Coin World dealer sight unseen, unless you knew that dealer from another context (show or other dealings?).

    It is one set of data points. I think the consistency issue is more interesting - submit the same coins every year and compare results.
    This is a YMMV (your mileage may vary) kind of article.

    Maurice
    Lurking with intent to loom
  • Options
    DennisHDennisH Posts: 13,974 ✭✭✭✭✭
    From the Publisher's standpoint, this was not a waste of time, but a bargain.

    Coin World is going to fill a LOT of editorial space with this little project, in what will probably run in multiple parts, and I'm guessing it will also give birth to at least one editorial. And shall we also contemplate the number of Letters to the Editor it will generate, therein filling even more space?

    And what did it cost them? A few cheap coins and several grading fees.

    Balanced against a writer traveling, plus expenses, the space-filling bang for the buck from this exercise is huge.

    -- Dennis (yes, I'm also involved in publishing)
    When in doubt, don't.
  • Options
    gemtone65gemtone65 Posts: 901 ✭✭✭
    DennisH: for the same level of effort, but a little more intelligence, CW could have achieved more private benefits, while simultaneously providing a significant service to the hobby. As it stands, CW provided no useful grading information, but inadvertently demonstrated the tawdry quality of the coins being offered by its own advertisers. Would you want to buy from these people when almost all of the coins chosen were found to have been intentionally doctered to deceive the buyer?
  • Options
    BigD5BigD5 Posts: 3,433
    I agree with most of the comments above, nice concept, wrong coins. Nice to know the Coin World advertisers are peddling "quality" material image
    I think the funniest thing is in the lower rung of the services, who's the worst? NTC? PCI? ACG? I don't think ACG is king of the scumbag slabbing services any longer. image
    If PCGS and NGC gave legitimate reasons for the bodybags, the survey could have been a bit more interesting.
    Again, nice concept, wrong coins, in my opinion.
    BigD5
    LSCC#1864

    Ebay Stuff
  • Options
    I don't get CoinWorld any more... Could you share more details?
  • Options
    newsmannewsman Posts: 2,658 ✭✭✭
    Dennis:

    As a professional editor and reporter who has traveled extensively on assignments, I don't get the impression any of their writers ever leave the office - their stories appear to be generated from working the phones. Also, I'll bet their travel budget is pretty tight, if they have one at all.

    One other observation about the test: They should have found a trustworthy professional grader to look at the coins and assign a grade. That would set some kind of baseline to compare all the services against, rather than just pitting them against each other.

    Chuck
  • Options
    ms70ms70 Posts: 13,951 ✭✭✭✭✭
    I think the coins submitted were fine. If they were all gems, then the services would probably be all very close by throwing out MS66 or 67 grades. It was better to see how they handled a coin in a more "challenging" condition for grading.

    Great transactions with oih82w8, JasonGaming, Moose1913.

  • Options
    I thought this was pretty well done and frankly I was surprised CoinWorld did something even this potentially controversial - they tend to take the path of 'least everything - don't offend anybody'.

    The results were more or less what I would have expected, with one exception: ACG actually rejected some coins and gave NG? I honestly did not know they ever did that.

    I agree with some others here that an interesting project would be to submit the same coin to each service 5 times over a 12 month period, for example, and see what kind of consistency, or lack thereof, results.
    Singapore
  • Options
    GilbertGilbert Posts: 1,533 ✭✭✭
    I actually find the study interesting and of value. As a matter of fact, it is something that had been suggested here for some time, and most seemed to think such a test had more merit than any other "blind test."

    I like the fact that it was "quietly"initiated in 2002. I think there is a healthy benefit of the study, like the price differences, turnaround times, and some of the results were quite informative, for me anyway. It definitely provided a bit of insight into how PCI has been viewed. I also think it pointed out were certain services are strong, weak, comparable and how some of them are a "crapshoot."

    I suppose someone will also have a less than positive view of just about any activity that doesn't necessarily provide them a direct benefit, criticizes their own position or those with a knack for viewing the negative rather than the positive (This is a generalization, so noone has to infer it is directed at any particularly respondent)

    I, for one, am somewhat pleased that the effort has been undertaken with the results published AND to get an idea how CW "spot checks" its advertisers. Maybe the latter should be improved upon, but most of the time, some action is better than no action at all.
    Gilbert
  • Options
    BigEBigE Posts: 6,949 ✭✭✭
    Did Coin World do this survey to boost the status of ACG?-------BigE
    I'm glad I am a Tree
  • Options
    SteveSteve Posts: 3,313 ✭✭✭
    Interesting how people have different conclusions from this CW test. Bottom line is I think the test was useful and informative. It dealt with ONE aspect of the coin grading controversy. We probably need other tests like sending in a set of 2003 Proof coins (10 coins) to all grading services and see what they come up with. Then sending in ONE coin five times to each service and see what they come up with. All this takes time and money to do. Maybe Numismatic News would like to try it? Steveimage
  • Options
    Cam40Cam40 Posts: 8,146
    Me too BigE .The most glaring thing to me was the fact that ACG was grading all of a sudden like NCG of something?
    They(ACG) obviously were in on it before the `test` began.

    I also agree if you read it right,you see how CW inadvertently demonstrates the tawdry quality of the
    coins being offered by its own advertisers.


    Yall are some excellent thinkers and writers. This place is great.

    image

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Emoji
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file