EPSE 592: Experimental Design & Analysis
2019/20, Winter Term 2
See the full syllabus here.
Office hours:
Thursdays 3:00 - 4:00 PM in Scarfe 2526.
At most other times, I will be in my office in Scarfe 2526.
Meeting times and locations:
Section 075: Thursdays, 4:30 - 7:30 PM, Scarfe 1021
Course overview:
This course will cover all the basics and essentials of experimental design and analysis. These methods have a long history and enjoy broad application in all of the natural and social sciences. We will discuss theory and applications. Mathematical foundations will form a component of the material, though our main focus will be on practical applications for researchers in a variety of disciplines.
Download Jamovi here:
https://www.jamovi.org/
Check out this short set of videos for a nice introduction to Jamovi.
Recommended textbooks:
- Fundamental Concepts in the Design of Experiments, Charles R. Hicks & Kenneth V. Turner, Jr. This is a superb textbook. It contains most of the relevant mathematics of the subject, but takes a very conversational and example-driven approach throughout.
- Analysis of Variance Designs, Glenn Gamst, Lawrence S. Meyers, & A.J. Guarino. A soft textbook written for social scientists. Very light on mathematical details, but many informative examples and case studies.
-Statistical Methods for Psychology, David C. Howell. A nice compromise text between the previous two in terms of technical content. An online copy can be found here.
Class Notes:
-Week 1: Introduction and Stats Review 1 (probability, random variables)
-Week 2: Stats Review 2 (random variables, sample statistics, basic inference, hypothesis testing)
-Week 3: Stats Review 3 (hypothesis testing, p-values, t-test, F-test)
-Week 4: Type I/II errors, multiple testing problem, one-way ANOVA
-Week 5: One-way ANOVA: assumptions of the ANOVA model and post hoc vs. pre-planned comparisons; intro to two-way ANOVA
-Week 6: Two-way ANOVA, n-way ANOVA; visualizing and interpreting interaction effects
-Week 7: Standardized measures of effect size; statistical power; power analysis
-Week 8: Unbalanced ANOVAs, restricted randomization and blocking; repeated measures ANOVA
-Week 9: Repeated measures ANOVA; analysis of covariance (ANCOVA)
-Week 10: RM-ANCOVA; Chi-squared tests (access lecture on UBC-Canvas)
-Week 11: Nonparametrics: Fisher's exact test, Mann-Whitney and Kruskal-Wallis tests (access lecture on UBC-Canvas)
-Week 1: Introduction and Stats Review 1 (probability, random variables)
- Extra notes on confounding variables from "Handbook of Biological Statistics" (HBS) by John H. McDonald.
- Extra notes on probability from HBS.
- Extra notes on probability and random variables from Oxford Stats.
- From Howell's SMP text: sections 5.1-5.5.
-Week 2: Stats Review 2 (random variables, sample statistics, basic inference, hypothesis testing)
- Extra notes on standard error of the mean from HBS.
- Extra notes on confidence intervals from HBS.
- Extra notes on hypothesis testing from HBS.
- From Howell's SMP text: chapters 2, 3, and 4.
-Week 3: Stats Review 3 (hypothesis testing, p-values, t-test, F-test)
- Extra notes on t-test from HBS.
- From Howell's SMP text: sections 7.1-7.6.
-Week 4: Type I/II errors, multiple testing problem, one-way ANOVA
- From Howell's SMP text: sections 4.7, 12.1 & 11.1-11.5.
-Week 5: One-way ANOVA: assumptions of the ANOVA model and post hoc vs. pre-planned comparisons; intro to two-way ANOVA
- From Howell's SMP text: section 11.8, 12.1-12.6, 13.1-13.5
- Anxiety vs. Education and Sex dataset from lecture notes
-Week 6: Two-way ANOVA, n-way ANOVA; visualizing and interpreting interaction effects
- From Howell's SMP text: sections 13.1-13.6
-Week 7: Standardized measures of effect size; statistical power; power analysis
- From Howell's SMP text: sections 13.7, 13.9, 13.11
- Oscar Olvera Astivia's blog post on the problems with G*Power
- Case Study: Durante et al. (2013)
- Case Study: Gelman & Carlin (2014)
-Week 8: Unbalanced ANOVAs, restricted randomization and blocking; repeated measures ANOVA
- From Howell's SMP text: sections 14.1 - 14.9
- Jamovi file for Technician/Supervisor example
-Week 9: Repeated measures ANOVA; analysis of covariance (ANCOVA)
- From Howell's SMP text: section 16.5
-Week 10: RM-ANCOVA; Chi-squared tests (access lecture on UBC-Canvas)
- From Howell's SMP text: section 6.1 - 6.6
- Case study: Motl et al. (2015)
-Week 11: Nonparametrics: Fisher's exact test, Mann-Whitney and Kruskal-Wallis tests (access lecture on UBC-Canvas)
- Extra notes on Fisher's exact test from HBS.
- Jamovi file for examples
- Flow chart of statistical techniques
Homeworks:
-Weeks 1, 2, & 3 problems: due in-class Jan. 30th.
-Weeks 4, 5, & 6 problems: due in-class Feb. 27th.
-Weeks 7, 8, & 9 problems: due in-class Mar. 26th.
-Weeks 10 & 11 problems: due Apr. 23.
-Weeks 1, 2, & 3 problems: due in-class Jan. 30th.
- TeX file for HW1 (optional for those who want to work in LaTeX)
-Weeks 4, 5, & 6 problems: due in-class Feb. 27th.
- TeX file for HW2 (optional for those who want to work in LaTeX)
- Data for Q2
- R code for Q2
-Weeks 7, 8, & 9 problems: due in-class Mar. 26th.
- TeX file for HW 3 (optional)
- Data for Q1
- R code for Q1
- R code for Q2(c)
- R code for Q2(d)-i
- R code for Q2(d)-ii
- Data for Q3
-Weeks 10 & 11 problems: due Apr. 23.
- TeX file for HW 4 (optional)
- Data for Q1
- R code for Q1(c)
- Data for Q2
- R code for Q2(a)
- R code for Q2(c)
- R code for Q2(d)
Final Exam:
- Take-home final exam (return as PDF by Apr. 30th)
- Case study for final: Sinaki et al. 2002