Experiments

STAT 20: Introduction to Probability and Statistics

Agenda

• Announcements
• Short Review
• Conducting Experiment

Announcements

• Portfolio 7 due on Friday at 11:59 pm
• Lab 4 will be released tomorrow and be due Friday August 14 (end of course)
• Final Exam is next Thursday August 13 and will cover everything.

Worksheet: Experiments

Appendix

Concept Questions

We run an experiment to see if informative phone calls encourage people to vote. We obtain phone numbers for 1000 registered voters and randomly assign half of them to receive calls from volunteers. The volunteers tell them the location of their polling place and the date of the election. Our outcome is whether or not the subjects vote in the next election.

Which of the following are possible covariates for our study?

1. The party affiliation of the voter (Republican or Democrat).
2. Whether the next election is a presidential election or not.
3. Whether the voter voted in the last election.
4. Whether the voter votes primarily for Republicans or Democrats in the next election.
5. Whether the treated voters hung up on the volunteer.

The point of this question is to get the students thinking about whether variables are measured before or after treatment assignment.A and C are correct answers, D and E are not (although E is measured before the primary outcome, it is still after treatment). B is technically a covariate but probably not a useful one; unless our experiments spans multiple election cycles, it will have the same value for all subjects.

01:00

Which of the following claims about covariate balance are true?

1. Randomized treatment assignment tends to produce covariate balance.
2. A standardized mean difference that is not equal to zero likely means that randomization was not conducted correctly.
3. The Love plot shows the (standardized) difference in means or proportions for each covariate across treatment groups.
4. In a hypothesis test for balance, the null hypothesis is that the treatment assignment and the covariate are independent.

All true except B

01:00

Running Experiments

• Focus on getting data now, make plots R etc later
• Please keep the classroom tidy and try not to spill
• If you have any “shaking” involved in your experiment, please open cans in bathroom sink and then return to classroom
• For each trial, be sure to record:
• Explanatory Variable (aka had cracker or not, falvor, fizzy or not)
• Response Variable The thing you are trying to measure (can they detect flavor, is drink more satisfying, can they eat 5 crackers etc)
• Order of Trial write down if this is trial 1,2,3,4,… in your data.
• So data frame should have at least 3 columns (maybe more if you are recording other covariates):