Archive for category science
Statistics-driven scientific methods slammed again
This December 13 article published by The New Yorker adds fuel to fire for deemphasizing significance testing as the criterion for accepting purported advancements in science. It’s well worth reading for anyone with a stake in statistics, despite raking over the same coals seen in this March 27 Science News article, which I discussed in a previous blog.*
“A lot of extraordinary scientific data are nothing but noise.”
– Jonah Lehrer, author of “The Truth Wears Off: Is there something wrong with the scientific method”
Evidently much of the bad science stems from “significance-chasers” – those who hunt out findings that pass the generally-accepted p-value of 5% for hypothesis testing. Unfortunately a statistically-significant outcome from an badly-designed experiment is of no value whatsoever.
PS. I credit blogger William Briggs for bringing this article to my attention. His attitude is provided succinctly by this assertion: “Scientists are too damn certain of themselves.”
*Misuse of statistics calls into question the credibility of science March 28, 2010.
A fruit fly by any other name is still a fruit fly
A good example of what South Korean educational system produces (see my previous blog) is their first astronaut, bioengineer Yi So-yeon, who was featured in this article Tuesday by The Korea Herald . During her mission at the International Space Station she completed a number of experiments, including one that involved the assistance of 1000 fruit flies.
If I were an astronaut going up with so many flies, I’d shake the container just before lift-off to get them up in the air and lighten the load. I heard about this trick from my next-door neighbor – a bee-keeper. He loaded up too many hives in his truck and it went over-weight, but he beat the inspectors by banging on the side with a hammer as he drove onto the scale.
Having segued to bees, here’s a heads-up about a study done by a group of 8- to 10-year-old British school children from Blackawton Primary School. They trained a bunch of bees to go to specific-colored and/or patterned targets by selectively rewarding them with sugar. This experiment met the standards of the Royal Society, which published the results in this Biology Letter. Also see these kind comments. Wired Science provides a ‘dumbed-down’ version with photos, that is, an executive summary 😉 here.
“We discovered that bumble-bees can use a combination of colour and spatial relationships in deciding which colour of flower to forage from. We also discovered that science is cool and fun because you get to do stuff that no one has ever done before.”
– Children from Blackawton
PS. Some folks think that drosophila melanogaster is a misnomer for this little critter that mysteriously spring up from discarded apples and the like. “The fruit fly’s name is likely to change to Sophophora melanogaster if results of a new evolutionary analysis are accepted” according to this April 2010 bulletin from the International Commission on Zoological Nomenclature. Who made them lords of the fruit fly?
Reaching your boiling point
Our marketing director emailed me this motivational video called “212° the extra degree.” this motivational video called “212° the extra degree”. It says that at this temperature water boils providing the steam needed to accomplish things. The idea is that only one degree of heat makes all the difference.
I get it. However, being a chemical engineer with an interest in being accurate about physical processes, I had to be troublesome by pointing out that here in Twin Cities at over 800 above sea-level the pressure drops enough that on average the boiling point drops to 210.5 F. But setting this aside and focusing only on the 1 degree between water and steam, one must keep in mind the huge difference of simply heating up water versus making it change state, the is, the heat (or enthalpy in technical terms) of vaporization.
Thank goodness that our marketing director had become accustomed to working with a bunch of engineers, statisticians and programmers who, when one asks “Could I talk with your for a minute?”, immediately set the timer on their digital watches for precisely 60 seconds (the the nearest one-hundredth).
Coincidentally, while vacationing in Wisconsin’s Door County, I enjoyed a fine demonstration of how hard it can be to bring a quantity of water to a boil. It’s a tradition there to throw a bunch of fish in one kettle and vegetables in another and cook them up with a wood fire. However, as I learned and experienced from a somewhat dangerous vantage point, a pitcher of kerosene provides the final heat needed to accomplish the boil-over. My eyebrows needed a bit of burn-back, so that’s OK.
Misuse of statistics calls into question the credibility of science
Posted by mark in science, Uncategorized on March 28, 2010
The current issue of Science News features an indictment of statistics by writer Tom Siegfried. He pulls no punches with statements like this:
“…a mutant form of math has deflected science’s heart..”
“Science was seduced by statistics…”
“…widespread misuse of statistical methods makes science more like a crapshoot.”
“It’s science’s dirtiest secret: …testing hypotheses by statistical analysis stands on a flimsy foundation.”
“Even when performed correctly, statistical tests are widely misunderstood and frequently misinterpreted. As a result, countless conclusions in the scientific literature are erroneous…”
Draw your own conclusions on whether science fails to face the shortcomings of statistics by reading Siegried’s article Odds Are, It’s Wrong.
My take on all this is that the misleading results boil down to several primary mistakes:
- Confusing correlation with causation
- Extrapolating from the region of experimentation to unstudied areas
- Touting statistically significant results that have no practical importance
- Reporting insignificant results from studies that lack power to see differences that could be very important as a practical matter.
I do not think statistics itself should be blamed. A poor workman blames his tools.
Test and evaluation of the Great Panjandrum – a spectacular failure for weaponry
Posted by mark in history, science, Uncategorized on March 23, 2010
When time becomes available – mainly while I do cardio-exercise on my home elliptical, I’ve been watching a classic 26-episode BBC series on The World at War that my oldest son gave me. It’s extremely compelling – rated 9.7 out of 10 by over two thousand voters at the Internet Movie Database (IMDb).
This morning I watched the chronicle of D-Day. Being that I just returned from the Annual National Test & Evaluation Conference by the National Defense Industry Association (NDIA), it was interesting to see what the boffins of Britain invented to defeat the defenses put up along the Normandy beaches. Perhaps the most amazing device was the Great Panjandrum, a rocket-propelled cart, which according to this write-up for Wikipedia was developed by the Admiralty’s Directorate of Miscellaneous Weapons Development. (One wonders about the “miscellaneous” bit.) The clip I viewed on the spectacular failure of the Great Panjandrum can be seen (along with other incredibly-inept military devices for D-Day) in a video on British Secret Wartime Follies posted in this article by UK’s Daily Mail. Check it out!
PS. The Brits continue to come up with the most audacious inventions, such as this flame-throwing moped developed as a deterrent against derelict drivers competing for motorway lanes.
Beware of bugs bearing backpacks
Posted by mark in science, Uncategorized on March 3, 2010
I am attending a conference sponsored by the National Defense Industry Association (NDIA). They provided all of us participants a copy of the latest issue (March) of their publication National Defense. While wiling away the time listening to some long-winded higher-ups I paged through the magazine and admired the weaponry developed to keep our war-fighters supported to the max. However, on page 17 a very odd picture caught my eye – a cockroach carrying a radiation sensor on its back! A researcher at Texas A&M reports that these bugs are ideal for sweeping potentially contaminated areas, ideally in teams of twenty. They can be operated remotely via devices that stimulate their leg muscles.
There is one problem though: Cockroaches cannot crawl backward. One had better hope that none of the bad guys wear pointy-toed cowboy boots, because they will be ideal for killing the sensor-bearing bugs that become stuck in the corners.
Skepticism versus cynicism about science experiments
Eric Felten’s latest “De Gustibus” column in Wall Street Journal reports New Episodes of Scientists Behaving Badly. It details various scandals, for example the retraction of a landmark publication linking autism to childhood vaccines. This creates a great deal of cynicism such as that expressed by this parent of a kid she helped on a science project:
“The experiments never turned out the way they were supposed to, and so we were always having to fudge the results so that the projects wouldn’t be screwy. I always felt guilty about that dishonesty, but now I feel like we were doing real science.”
Ouch!
Coincidentally, Stat-Ease received an email from someone who goes by the pen-name “The Pyrrhonist.” (I see a trend here: I need to work on a scholarly-sounding moniker.) While researching pyrrhonism, I came across this skeptical quote by a Greek named Carneades who set the stage for his countryman Pyrrho:
“Nothing can be known, not even this.”
That’s tough to get around!
I truly believe that some degree of skepticism is healthy, such as judicious use of the null hypothesis for assessing the outcome of experiments. However, it’s not good for experimenters to abandon all standards by succumbing to an attitude of scornful or jaded negativity, especially a general distrust of the integrity or professed motives of others – the definition of cynicism (according to the Free Dictionary).
So, be skeptical, but not cynical.
Tiny rotifers defeat the Red Queen
This week’s NPR Science Friday presented a fascinating report on rotifers, also known as “wheel animalcules”* due to the way they rotor food into their cylindrical bodies.** Besides being so funny-looking, these critters are unique in being only female — no guys to bother with (a bit of a bummer coming up as we are to Valentine’s Day). According to the Red Queen hypothesis this single gender situation should have put rotifers at an evolutionary disadvantage. However, these animalcules manage to thrive, albeit plagued by parasites. They survive by tolerating dehydration for amazing-long periods while riding the wind to their next home – typically a single drop of water.
Check out this entertaining Science Friday video on rotifers, which features new research by Paul Sherman and Chris Wilson of Cornell University. Warning: Although this production would be rated “G” for gender, it may not be suitable for children due to some horrifying imagery of lethal fungal parasites.
*Detailed in Welcome to the Wonderfully Weird World of Rotifers
**Seen in the brief video Life in a Drop of Water: Rotifer
Apples and oranges comparison of diets?
Posted by mark in science, Uncategorized, Wellness on January 21, 2010
While exercising on my elliptical machine this morning watching ABC’s Good Morning America the show captured my attention with a report that Weight Watchers (“WW”) this week filed a lawsuit against one of its top competitors, Jenny Craig (“JC”). The dispute stems from a claim by JC that their clients lost, on average, over twice as much weight as those on the largest weight loss program. WW alleges that this claim is deceptive due it comparing a study by JC done this year versus one done by WW 10 years ago. According to this news release by Weight Watchers the complaint states that generally accepted standards of biomedical research require Jenny Craig to compare the two current offerings of both companies through a head-to-head randomized clinical trial.
“You can’t compare studies that were done in different locations at different times using different groups of people.”
– Louis Aronne, M.D, New York Presbyterian Hospital weight loss expert and author of Eat This, Not That
Although the judge has put a temporary restraining order against their offending ad, I wouldn’t rule out the JC claim prima facie. After all, as Smartmoney Magazine writer Angie Marek stated in her column on The Skinny on Big, Fat Diet Programs “the science on most of these plans is hardly conclusive, since most of the research has been paid for by the diet companies themselves.” In fact, I predict that this case will keep at least two statisticians fat and sassy as expert witnesses (one on each side of this tug-of-war).
Atlantic claws coming to town this Christmas
I came across this unusually bold crab a few weeks ago while beach-walking in Florida.
Perhaps the size of this creature is explained by findings of marine geologist Justin Ries of the University of North Carolina, who reports that rising levels of atmospheric carbon dioxide may lead to larger crabs, shrimp and lobsters.
See a summary of Ries’s research and a picture of a monster lobster in this post by NPR. Wow, these exoskeletoned creatures really like carbon!
PS. All this talk of large lobsters reminds me of an illustration of evolutionary operation (EVOP) by Box and Draper.* Their process improvement method calls an ongoing series of two-level factorial designs that illuminate a path to more desirable manufacturing conditions. I will talk more about this in a future blog.
*Box, G. E. P. and N. R. Draper, Evolutionary Operation, Wiley New York, 1969. (Wiley Classics Library, paperback edition, 1998.)