What This Document Is
This resource is a focused exploration of significance tests and p-values within the field of research design and analysis. It delves into common misunderstandings surrounding these statistical concepts, aiming to clarify their proper interpretation and application. It’s designed for students seeking a deeper, more nuanced understanding beyond basic calculations, and focuses on conceptual clarity rather than procedural steps. This material is part of the PSCH 543 course at the University of Illinois at Chicago.
Why This Document Matters
This resource is particularly beneficial for students who are actively conducting research, analyzing data, or critically evaluating published studies. It’s ideal for those who want to avoid pitfalls in interpreting statistical results and ensure they are drawing valid conclusions from their work. Understanding these concepts is crucial for anyone aiming to become a discerning consumer and producer of research, and will support more informed decision-making in your studies and future career. If you’re grappling with the meaning of p-values or questioning the implications of “statistically significant” findings, this will be a valuable resource.
Topics Covered
* Common misinterpretations of p-values and significance testing
* The conditional probability nature of p-values
* The relationship between p-values and the probability of the null hypothesis
* The role of Bayes’ Theorem in interpreting statistical results
* The distinction between statistical significance and replicability
* The concept of statistical power and its impact on research findings
* Evaluating the practical significance of research results using effect sizes
* The influence of sample size on p-values and effect sizes
What This Document Provides
* A detailed examination of frequently held, yet inaccurate, beliefs about significance tests.
* A framework for understanding how to move beyond simply reporting p-values.
* Discussion of how prior beliefs and alternative hypotheses influence interpretation.
* Exploration of how to assess the strength and importance of research findings.
* Insights into the factors that determine the reliability and replicability of research.
* An overview of various effect size measures and their application.