Advanced Research Methods 4080/5080--Revised
Spring, 2020
10:20-11:15 MWF, COE 247

 

Instructor: Dr. William Langston
Office: JH 100
Phone: 615/898-5489 (office)
email: william.langston@mtsu.edu
Office Hours: 12-1 T, 1-2 W, please email if you plan to come to office hours, feel free to email to arrange appointments outside of office hours.

[Text] [Description] [Responsibilities] [Grading] [Policies] [Calendar]
 
Text:
 
Required: Any articles for discussion (you'll receive an email with links as they come up).

Recommended: Ray, W. J. (2012). Methods Toward a Science of Behavior and Experience (10th Ed.). Belmont, CA: Wadsworth.
 
Recommended: Langston, W. (2011). Research Methods Laboratory Manual for Psychology (3rd Ed.). Pacific Grove, CA: Wadsworth. (Link)
(This will be a good resource for independent project ideas if you don't have one of your own.)

Top
 
Course Description:
 
In this course we will go beyond the basic course in research methods. There are three big components to this. First, you will complete a project and present it at a conference. The project will be your idea and will be entirely under your control. Second, we will cover "the next 30 minutes" of the regular research methods class. The content is a little more advanced, but only in the sense that we actually get to go over things completely. Third, you will get to interact with the material in a more direct way. We'll read some research papers, think more about how science works, and we will have more class discussions and activities that allow you to apply what you are learning.
 
Top
 
Course Responsibilities:
 
1. Quizzes/Homeworks/In-class Presentations: We will have routine quizzes and homeworks. The quizzes are diagnostic and let me know what you are learning. The homeworks will relate to the project and will serve as concrete milestones to keep you on track. The presentations will be opportunities for your peers to give you feedback. These assignments are worth 10 pts. each, I will count your best 10.
2. Research report: You will write one APA formatted report based on the project.
3. Presentation: You will present your work at MTPA on April 25. This will be an oral presentation using PowerPoint.
 
Top
 
Points/Grades:
 
Assignments: Description: Points:
Quizzes/Homeworks
10 @ 10 each
100
5080: WRRs
5 @ 10 each
50
Research report

100
Presentation

100
Intangibles (attendance, class participation, etc.)

100
TOTAL

400 4080/450 5080
5080: WRRs are required from homeworks 2, 3, 5, 7, and 10

Your grade will be based on the number of points earned (for 5080, do the math out of 450 points, and you have A- as a possibility). Totals:

>360 = A; >348 = B+; >332 = B; >320 = B-; >308 = C+; >292 = C; >280 = C-; >268 = D+; >252 = D; > 240 = D-; >0 = F.
 
Top
 
General Policies:
 
1. Attendance: Attendance is mandatory. I will pass around a sign-up sheet every day. Only people with perfect attendance will be allowed to take advantage of extra credit opportunities.
2. Late policy: Complete assignments on time.
 Type of assignment: Penalty
Homeworks
Not accepted after Friday of the week they’re due
Quizzes
No make-ups offered 
Papers*

 Late, but doesn't inconvenience me 
No penalty
 Some level of inconvenience 10% - 100%
*Papers turned in before I start grading are not late, regardless of the due date.
3. Grading guarantee (my late policy): Papers will be returned within two weeks of the final due date. Bonus points will be awarded at the rate of five points per incomplete paper per day until they are graded. Bonus points will be divided equally amongst all assignments turned in to me on time, for anyone with perfect attendance.
4. Missed assignments: If you know in advance, notify me to make arrangements.
5. Course notes are available on the web at http://www.mtsu.edu/~wlangsto/AdvRM.html. Also, the regular research methods page has some important information at http://www.mtsu.edu/~wlangsto/RM.html.
6. Drop deadlines: The last day to drop without a grade is February 3. The last day to drop is April 10 (you will receive some sort of grade). If you stay in the class after this date, you will not be able to drop unless you experience a major tragedy or emergency. I am not the person who makes that determination. Incompletes will only be given if you have successfully completed the majority of the coursework and were prevented from finishing by a major tragedy or emergency.
7. Any student engaging in any form of academic misconduct will lose credit for the relevant assignment and will be subjected to the appropriate university judicial proceedings.
8. If you experience problems in the course, see me. You’re welcome in my office anytime.
9. Reasonable accommodations for students with disabilities: If you require assistance or accommodation (e.g., testing, note-taking, etc.), or you have questions related to such accommodations, speak to me as soon as possible. Also, the Disability and Access Center (615-898-2783) can provide information about such accommodations. Additional information is here: http://www.mtsu.edu/ada/syllabus.php.
10. Do you have a lottery scholarship? To retain the Tennessee Education Lottery Scholarship eligibility, you must earn a cumulative TELS GPA of 2.75 after 24 and 48 attempted hours and a cumulative TELS GPA of 3.0 thereafter. A grade of C, D, F, FA, or I in this class may negatively impact TELS eligibility. If you drop this class, withdraw, or if you stop attending this class you may lose eligibility for your lottery scholarship, and you may not be able to regain eligibility at a later time. For additional Lottery rules, please refer to your Lottery Statement of Understanding form (http://www.mtsu.edu/financial-aid/forms/LOTFOD.pdf) or contact your MT One Stop Enrollment Counselor (http://www.mtsu.edu/one-stop/counselor.php).
11. MTSU faculty are concerned about the well-being and development of our students and are legally obligated to share reports of sexual assault, dating violence, domestic violence and stalking with the University’s Title IX coordinator to help ensure student’s safety and welfare. Please refer to MTSU’s Title IX site for contact information and details: http://www.mtsu.edu/titleix/
 
Top
 
Schedule of events:
 
Week of:  Topic: Read: 
1/20
H O L I D A Y Monday, 1/20

Course introduction
1/27
Science--How do we know things?
Longino (1990) (I'll email the relevant parts.)


Snook, B., Cullen, R. M., Bennell, C., Taylor, P. J., & Gendreau, P. (2008). The criminal profiling illusion: What's behind the smoke and mirrors? Criminal Justice and Behavior, 35, 1257-1276. doi: 10.1177/0093854808321528

Research goal: Choose project topic

2/3
What is science?
Science versus pseudoscience and risky predictions: Popper, K. R. (1962). Conjectures and refutations: The growth of scientific knowledge. New York: Basic Books. (Chapter 1)
http://www.nemenmanlab.org/~ilya/images/0/07/Popper-1953.pdf
For more on Popper and problems with using risky prediction as the basis of the difference between science and pseudoscience (from the Stanford Encyclopedia of Philosophy): http://plato.stanford.edu/entries/popper/


Langmuir, I., & Hall, R. N. (1989). Pathological Science. Physics Today, 42, 36-48. doi:10.1063/1.881205 (I'll email it)


Park, R. L. (2003). The seven warning signs of bogus science. The Chronicle of Higher Education, 49, B20. Retrieved from http://chronicle.com/article/The-Seven-Warning-Signs-of/13674

Research goal: Project design

2/10
Methodological concerns
Why double blind? Rosenthal, R., Kohn, P., Greenfield, P. M., & Carota, N. (1966). Data desirability, experimenter expectancy, and the results of psychological research. Journal of Personality and Social Psychology, 3, 20-27. doi:10.1037/h0022604 (Get it from PsycInfo)


Demand characteristics: Orne, M. T. (1962). On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications. American Psychologist, 17, 776-783. doi:10.1037/h0043424 (Get it from PsycInfo)


Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281-302. http://dx.doi.org/10.1037/h0040957 (Get it from PsycInfo)


Meehl, P. E. (1956). Wanted--A good cookbook. American Psychologist, 11, 263-272. http://dx.doi.org/10.1037/h0044164 (Get it from PsycInfo)

Presentation: Present project design to class, 2/14

2/17
Methodological concerns in action
King, R. N., & Koehler, D. J. (2000). Illusory correlations in graphological inference. Journal of Experimental Psychology: Applied, 6, 336-348. doi:10.1037/1076-898X.6.4.336 (Get it from PsycInfo)


Rozin, P., Millman, L., & Nemeroff, C. (1986). Operation of the laws of sympathetic magic in disgust and other domains. Journal of Personality and Social Psychology, 50, 703-712. doi:10.1037/0022-3514.50.4.703 (Get it from PsycInfo)


Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359-1366. http://dx.doi.org/10.1177/0956797611417632


Simons, D. J., Boot, W. R., Charness, N., Gathercole, S. E., Chabris, C. F., Hambrick, D. Z., & Stine-Morrow, E. A. L. (2016). Do "brain-training" programs work? Psychological Science in the Public Interest, 17, 103-191. http://dx.doi.org/10.1177/1529100616661983 (Our interest is the section labeled "Recommendations" starting on p. 161 and especially the checklist on p. 171.)

Research goal: IRB draft

2/24
Catch up time/Ethics Terms and design discussion


Beecher, H. K. (1966). Ethics and clinical research. The New England Journal of Medicine, 274, 1354-1360. (You can get it from PsycInfo by adding the MEDLINE with full text database)


Milgram, S. (1963). Behavioral study of obedience. Journal of Abnormal and Social Psychology, 67, 371-378. http://dx.doi.org/10.1037/h0040525 (Get it from PsycInfo)


Baumrind, D. (1964). Some thoughts on ethics of research: After reading Milgram's "Behavioral study of obedience." American Psychologist, 19, 421-423. http://dx.doi.org/10.1037/h0040128 (Get it from PsycInfo)


West, S. G., Gunn, S. P., & Chernicky, P. (1975). Ubiquitous Watergate: An attributional analysis. Journal of Personality and Social Psychology, 32, 55-65. http://dx.doi.org/10.1037/h0076858 (Get it from PsycInfo)


Cook, S. W. (1975). A comment on the ethical issues involved in West, Gunn, and Chernicky's "Ubiquitous Watergate: An attributional analysis." Journal of Personality and Social Psychology, 32, http://dx.doi.org/10.1037/h0076848 (Get it from PsycInfo)


Middlemist, R. D., Knowles, E. S., & Matter, C. F. (1976). Personal space invasions in the lavatory: Suggestive evidence for arousal. Journal of Personality and Social Psychology, 33, 541-546. http://dx.doi.org/10.1037/0022-3514.33.5.541 (Get it from PsycInfo)


Koocher, G. P. (1977). Bathroom behavior and human dignity. Journal of Personality and Social Psychology, 35, 120-121. http://dx.doi.org/10.1037/0022-3514.35.2.120 (Get it from PsycInfo)


Middlemist, R. D., Knowles, E. S., & Matter, C. F. (1977). What to do and what to report: A reply to Koocher. Journal of Personality and Social Psychology, 35, 122-124. http://dx.doi.org/10.1037/0022-3514.35.2.122 (Get it from PsycInfo)
3/2
Catch up time


Presentation: Literature review/project foundation, 3/6


Research goal: Submit IRB
3/9
S P R I N G  B R E A K
3/16
S P R I N G  B R E A K
3/23
Putting cause in a box Campbell, D. T., & Stanley, J. C. (1963). Experimental and quasi-experimental designs for research. Chicago: Rand McNally and Company. (I'll email the relevant parts; get the whole thing here https://www.jameslindlibrary.org/campbell-dt-stanley-jc-1963/.)


Haydon, T., Mancil, G. R., & Van Loan, C. (2009). Using opportunities to respond in a general education classroom: A case study. Education and Treatment of Children, 32, 267-278. doi: 10.1353/etc.0.0052

Research goal: Begin data collection (if approved)

3/30
Kinds of design
Coover, J. E. (1913). “The feeling of being stared at”: Experimental. The American Journal of Psychology, 24, 570-575. doi: 10.2307/1413454


Bressan, P. (2002). The connection between random sequences, everyday coincidences, and belief in the paranormal. Applied Cognitive Psychology, 16, 17-34. doi: 10.1002/acp.754


Markovsky, B., & Thye, S. R. (2001). Social influence on paranormal beliefs. Sociological Perspectives, 44, 21-44. doi: 10.1525/sop.2001.44.1.21 (Get it from PsycInfo.)


Foertsch, J., & Gernsbacher, M. A. (1997). In search of gender neutrality: Is singular they a cognitively efficient substitute for generic he? Psychological Science, 8, 106-111. doi: 10.1111/j.1467-9280.1997.tb00691.x

Research goal: Continue data collection

4/6 More complicated issues Platt, J. R. (1964). Strong Inference. Science, 146, 347-353. http://dx.doi.org/10.1126/science.146.3642.347 (Get it from http://vision.ucsf.edu/dunnlab/Platt1964.pdf)


Crafts, L. W., Schneirla, T. C., Robinson, E. E., & Gilbert, R. W. (1950). The perception of obstacles by the blind in Recent Experiments in Psychology, pp.137-169. The book is online, you will need to go to Chapter IX, starting on p. 155 of the pdf. http://www.archive.org/details/recentexperiment031290mbp


Karpicke, J. D., & Roediger, H. L., III. (2008). The critical importance of retrieval for learning. Science, 319, 966-968. doi:10.1126/science.1152408


Coren, S. (1986). An efferent component in the visual perception of direction and extent. Psychological Review, 93, 391-410. doi: 10.1037/0033-295X.93.4.391 (Get it from PsycInfo.)

Research goal: Data analysis

4/13
Individual meetings--email


Research goal: Finalize data analysis, draft of presentation

4/20
Presentations/critiques


MTPA, Saturday, April 25, 8:30 AM--VIRTUAL

4/27
MTPA debrief


Catch up time


Final thoughts on science and method

Please note: Some due dates and topics may shift to later dates. In no event will due dates be moved to an earlier date.
Top

Research Methods Syllabus
Will Langston
 Back to Langston's Advanced Research Methods Page