Hide Advanced Options
Courses - Summer 2026
SURV
Survey and Data Science Department Site
Open Seats as of
03/18/2026 at 10:30 PM
SURV603
(Perm Req)
Benchmarking AI Models Using Surveys
Credits: 1
Grad Meth: Reg, Aud
Recommended: Basic knowledge of Python; Able to obtain API access/tokens for advanced LLM services (e.g., OpenAI or Google). We will cover API usage during the course, so prior experience is not required.
Additional information: This course will be a part of the lineup of online courses and students will be able to count this course as an elective toward any of the JPSM online programs: MPDS, and certificates Z127, Z129, and Z133.
Introduces the concepts of benchmarking AI using surveys as tools. The course provides an overview of understanding the AI-as-respondent interaction and offers practical insights into using AI as proxies for human participants to respond to survey items. The course covers methods, techniques, and real-world examples for designing and conducting benchmark studies to assess AI performance and bias through surveys as a testing tool, as well as its utility in reliably generating and analyzing survey data.
This course introduces the concepts of benchmarking AI using surveys as tools. The course provides an overview of understanding the AI-as-respondent interaction and offers practical insights into using AI as proxies for human participants to respond to survey items. The course covers methods, techniques, and real-world examples for designing and conducting benchmark studies to assess AI performance and bias through surveys as a testing tool, as well as its utility in reliably generating and analyzing survey data.