5 September 2018

Science and statistics

Statistics: contextual problem solving

  • Research design
  • Summary
  • Visualization
  • Fallacies/“paradoxes”

When all you’ve got is a hammer

“Null hypothesis significance testing”

  • Bastardization of classical significance testing logic
  • Focus on single hypothesis
  • Focus on single “effect”
  • Focus on single criterion for “existence”
  • Statistical rejection mistaken for theoretical support

A replication crisis?

Newly popular: Replication attempts

  • Reproducibility Project: Psychology
  • “Many labs” projects
  • Large-scale replications by skeptics

The hammer strikes again

  • Single effects
  • Primary outcome: “Is replication ‘significant’?”

Many replications “fail” (!)

Redefine statistical significance (RS)?