NEW AND IMPROVED

This blog is now sugar FREE, fat FREE, gluten FREE, all ORGANIC and all NATURAL!!

Tuesday, May 8, 2012

Playing With Statistics

Playing With Statistics


I tend to be skeptical about experts and statistical analysis.  It is very easy to play with numbers.  It is also easy to pick and choose those numbers which support whatever agenda experts wish to support.

I knew a person who worked for a consulting firm that dealt with the Defense Department.  He told me that when given an assignment to analyze the first question they asked was “What would you like the outcome to be?”

The other day President Obama was touting the new unemployment figures.  The country added 115,000 new jobs and the unemployment rate fell from 8.2% to 8.1%.  Certainly this was a good thing and worth bragging about.  

Wall Street disagreed. 

The market fell.   Some claimed the unemployment rate dropped because many unemployed have become frustrated and have stopped looking for work.  Furthermore it has been pointed out that at the current downward unemployment trend it will take over four years for the country to reach what is considered “full” employment.

It is all just numbers. 

Is the planet warming?  Experts say yes, at the rate of one degree every100 years.  Am I concerned?  Yes.  Am I skeptical?  Well in the world of statistics, one degree every  100 years as measured….umm I don’t know, by whom….umm I don’t know….there is a lot of wiggle room here.  (Relax greenies, I am still concerned.  Just making a point here.  Freeking PC crap.)

If you are dealing with large numbers and want to emphasize a point you use the actual numbers.  I.E. - The President won the last election by over two million votes sounds like a lot doesn’t it.  If you want to minimize a point you use percentage – The President won the last election by less than one percent (Relax this is just a hypothetical example, I do not know or care what the actual numbers were.  You people are so sensitive!)

Inflation is a good one.  How is it measured?  If we use food and fuel, the rate of inflation is high.  If we use appliances like TV’s DVD’s and PC’s the rate of inflation is negative.  How do you factor quality and technological advances into the inflation equation?  It depends on the result you want.

When I worked for Merrill Lynch many years ago, our department provided many trading statistics.  One such statistic was the daily percentage of shares which were traded on the New York Stock Exchange which were executed by Merrill Lynch customers.  It was generally around 5%. 

One day a Wall Street Journal article reported that Merrill Lynch executed 10% of all shares traded on the NYSE.  This number came from the Merrill Lynch CEO, Stan O’Neil. 

My boss wanted to know why our department reported the percentage as 5% and our CEO reported 10%.  The explanation was simple.  Mr. O’Neil’s people took the total shares for a day executed by Merrill customers, 50 million, and the total shares executed on the NYSE, 500 million and came up with the 10% figure. 

The problem is that the NYSE reports shares which change ownership – I buy 100, you sell 100 equals 100 exchanged.  The Merrill customer transactions were total executions – I buy 100, you sell 100, total traded equals 200.

I explained this to my boss.  I told him that we always doubled the exchange figure to report the accurate number as 5%.  My boss told me, “The CEO of Merrill Lynch thinks we execute 10% of all trades on the New York Stock Exchange.  From now on, that is the number we will report.” 

So let it be written, so let it be done!

The 10% number was never challenged.

I am skeptical about statistics!       

11 comments:

  1. I think 'Statistics' is another way of saying 'Lies'!

    ReplyDelete
  2. My eyes are crossing and my head is spinning...help!

    ReplyDelete
  3. Excellent post! That's why they call them "lies, damn lies, and statistics", in decending order of believeability.

    S

    ReplyDelete
  4. Statistically speaking every man and woman has 1 testical and one ovary.

    ReplyDelete
  5. Hmmmmm! There are lies, damned lies and then there's statistics,

    Highly paid statisticians and mathematicians analyse trends in the insurance market to assess what the 'Risk Rate' should be anything that is "insured".

    Risk Managers look at the analysts results and apply the 80/20 rule - something that has no scientific foundation but has ruled insurance for decades.

    What is it? Well, 80% of policies are "safe" and are pure money earners. The other 20% are risky but some are higher risk than others -(in fact, 80% of the 20% are relatively low risk and the remainder 20% are outrageously high risk!)

    So what do the portfolio managers do - they average out the potential losses from that 20% of 20% and load it on to the bulk of the no risk and low risk claims so that you, the policy holder, carries "The Risk" and the insurers collect both ways!

    ReplyDelete
  6. Exactly JohnD....wait...WHAT?

    ReplyDelete
  7. You've just made a skeptic out of me, too.

    ReplyDelete
  8. Ha ha ha
    Loved this post as my hubby's job involves a certain amount of statistical work - it's mostly just common sense but they do the statistical thing to justify the common sense I think...

    I will take great pleasure in telling him that stats are just lies in disguise - especially since he proudly tells me he never lies.......lmao

    Lou :-)

    ReplyDelete
  9. I like to use many different statistics to rate performance the fast-pitch softball teams I coach, so I know very well the pitfalls of stats. I can take almost any ONE stat, say batting average, and either inflate the importance by contrast with another (RBI, R scored, whatever) or make it seem less important, which can be used as a motivational tool to get some player to hate me and say, "Sully doesn't know what he's talking about. I'll show him!"

    Good stuff here. Thanks!

    (Came from Uncle Skip's place, by the way.)

    ReplyDelete