Abstract
Thanks to platforms such as Prolific and other vetted panels, researchers across the social sciences can now conduct large-sample surveys and controlled experiments with unprecedented speed and reach. Yet the validity of online data is increasingly threatened by sampling biases, inattentive or impersonating participants, professional respondents, and AI-generated responses.
This course equips students to harness the full potential of online experimentation鈥攊ncluding research designs often deemed unfeasible outside the physical lab鈥攚hile meeting the highest standards of rigor, transparency, and reproducibility expected by leading journals in marketing, management, psychology, and related fields. Participants will learn how to detect and prevent common threats to research validity, implement state-of-the-art quality-control techniques, and design studies that remain credible in a rapidly evolving online research environment.
Beyond avoiding pitfalls, the course emphasizes creativity and innovation in experimental design, showing how digital tools can expand鈥攔ather than constrain鈥攖he behavioral researcher鈥檚 toolkit. Throughout, technical and methodological insights are explicitly tied to participants鈥 own research, serving the broader aim of strengthening the design, execution, and reporting of their projects, and ultimately increasing their chances of successful publication.
Registration is closed.
We will cover a broad set of topics essential to conducting high-quality online research, including those outlined below. We will do so through a combination of lectures, demonstrations, and discussions. Critically, all material will be connected to your own research, and you will receive individualized feedback on your projects throughout the course.
-Basic Decisions in Online Research (e.g., sample size, payment, study description/advertising, including preregistration of online studies)
-Sampling Issues (e.g., going beyond WEIRD samples, representative sampling, reducing sampling bias, recruiting rare populations, avoiding imposters)
-Dealing with Threats to Data Quality (e.g., AI agents and bots, AI usage by participants, non-naive participants, inattentive and dishonest participants)
-Advanced Study Designs (e.g., incentivizing participants, stimulus selection, interactive, longitudinal, and cross-cultural designs, studies involving physical interactions, innovative methods)
-Reporting Online Research (e.g., constraints on generality, ensuring reproducibility, implementing open science practices)
-Publishing Online Research (e.g., going beyond scenario studies, increasing external and ecological validity, field studies, 鈥淎/B testing鈥, 鈥渞eal鈥 choices online)
By the end of the course, you will know everything that, in 2026, is critical to design, execute, report, and publish valid online research, irrespective of your field (e.g., marketing, management, psychology, economics, etc.). You will also have made concrete progress on your own research projects.
Four readings are mandatory to make before the course starts:
Mize, T. D., & Manago, B. (2022). The past, present, and future of experimental methods in the social sciences. Social Science Research, 108, 102799.
Chandler J. (2023) Participant Recruitment. In: Nichols AL, Edlund J, eds. The Cambridge Handbook of Research Methods and Statistics for the Social and Behavioral Sciences: Volume 1: Building a Program of Research. Cambridge Handbooks in Psychology. Cambridge University Press; 179-201.
Munaf貌, M. R., Nosek, B. A., ... & Ioannidis, J. (2017). A manifesto for reproducible science. Nature Human Behaviour, 1(1), 1-9.
Simmons, J., D Nelson, L., & Simonsohn, U. (2021). Pre鈥恟egistration: Why and how. Journal of Consumer Psychology, 31(1), 151-162.
LeBel, E. P., McCarthy, R. J., Earp, B. D., Elson, M., & Vanpaemel, W. (2018). A Unified Framework to Quantify the Credibility of Scientific Findings. Advances in Methods and Practices in Psychological Science, 1, 389-402.
More literature will be shared when the course starts, for students to integrate with the course material (slides, tutorials)
Assessment
Assessment will be based on a take-home assignment that you will hand in approximately one week after the course. You will outline an online research approach to address your own research question, detailing your study design and explaining how your implementation and reporting choices mitigate the key threats discussed during the course.
At the beginning of the course, I will provide you with a slide-deck template designed to prompt and structure your critical design decisions. Throughout the course, you are encouraged to work on your project, progressively complete the slide deck, and receive feedback from me. At the end of the course, you will submit a short recorded video presentation accompanying your slides, which will serve as the basis for assessment.
Workload
Pre-readings: 10 hours
Online sessions: 18 hours
Self-study (literature, slides, tutorials): 26 hours
Assignment/project: 30 hours
(Total 84 hours)
Attendance
Attendance is mandatory, though you will not be penalized if you have to miss a session. The course certificate will be issued only to participants who successfully completed the course assessment.
Contact
- Content related questions
Dr. Gabriele Paolacci
Email address - Enrolment related questions
ERIM Doctoral Office
Email address
Register directly via the . If you have previously attended a course at 美女福利电影院午夜, you will already have an EUR account. If not, you will be asked to create one to complete your enrolment and receive access to course materials.
- Browse courses: Select the course that interests you and click on 'Enroll'.
- Create an account: Submit the details for your account. You will need it to access the course materials via the university鈥檚 learning management system.
- Complete registration: Fill out the registration form and submit payment.
- Confirmation: Receive a confirmation email with course details.
ERIM Full-time and Part-time PhD candidates as well as ERIM members can register free of charge via the university鈥檚 student information system, . A valid EUR student account is required to log in and complete enrolment.
If you encounter any issues accessing the course site, we recommend copying and pasting the link into an incognito/private browser window.
If you already have an Osiris account and encounter difficulties, please contact ERIM Doctoral office via summerschool@erim.eur.nl and they can assist by registering directly for your preferred Summer School courses.
Course fee: 鈧250 per EC credit
Courses are available free of charge for ERIM members and ERIM Full-time & Part-time PhD candidates.
After you submit the online application form, you will receive further instructions from ERIM Doctoral Office regarding payment options, including by bank transfer (invoice) or direct payment by credit card, iDeal.
Your spot in the course is confirmed once payment is received.
Course materials will be available via , the university鈥檚 learning management system. You can access them using the account provided upon registration. If you encounter issues, try copying the link into an incognito/private browser window.
By default, all announcements from Canvas are sent to your EUR student email account. You can add your preferred personal email address under Canvas > User Account > Settings > Ways to connect (right side menu).
If you forgot your password, please contact EUR IT Helpdesk through it.servicedesk@eur.nl.
Participation in ERIM Summer School grants you also access to Erasmus University Library. The online collection includes e-journals, e-books, online articles and other resources. It can be accessed easily through the Library website with your EUR student account.