A course at Télécom Paris about the use of quantitative methods for user-experience research.

Course materials

Below are materials from the class, organised by week.

2025-26

For this year:

Data

Lecture 4 readings

open-access:

  • Callegaro, M., Yang, Y. (2018). The Role of Surveys in the Era of “Big Data”. In: Vannette, D., Krosnick, J. (eds) The Palgrave Handbook of Survey Research . Palgrave Macmillan, Cham. https://doi.org/10.1007/978-3-319-54395-6_23

2024-25

Week 1 “introduction to quant UX”

  • Quick survey
  • googledoc to report teams and topics
  • slides

Week 2 “Metrics”

  • slides

Week 3 – Analysis of data logs, guest-speaker Ben Davison, Google

Week 4 – Testing

Week 5 – Guest speaker

Week 6 – Ethics

  • slides
  • Select one of the following texts to discuss in class:
  1. Kate Crawford, Atlas of AI (excerpt)
  2. Jer Thorp, Living in Data (excerpt)
  3. Gray et al 2018, The Dark (Patterns) Side of UX Design
  4. Larose and Barron (2017)

Week 7 – group work

Week 8 – final presentations (no slides)

2023-24

Week 1

  • slides [main content]

Week 2 – Measuring UX with self-reports

  • slides
  • code – https://github.com/pmavros/ses216/
  • demo – https://lqaunfp7ae.cognition.run [URL will go inactive in a few months]
  • analysis code in R

Week 3 – Measuring UX with behavioural and other data

  • slides

Week 4 – presentations, no materials

Week 5 – click on links: password = qu4ntitative

  1. Kate Crawford, Atlas of AI (excerpt)
  2. Jer Thorp, Living in Data (excerpt)
  3. Gray et al 2018, The Dark (Patterns) Side of UX Design
  4. Larose and Barron (2017)
  5. also
    • https://gdpr.eu/what-is-gdpr/
    • https://www.deceptive.design/

Week 6 –

  • data (task 2)
  • chart types – flowdata.com
  • slides
  • Presentation instructions
  • Report instructions

Week 7 – group work, no materials

Week 8 – presentation day, no materials

Presentation instructions

We are 11 teams, and the class is 3hrs = 180 minute / 11 teams ~ 15 minutes per team. Therefore,

  • 10 minutes presentation
  • 5 minutes discussion and feedback
  • There will be timekeeping

The presentation needs to be complete and standalone. Assume this is the first time we hear about your project, so make sure to introduce it. Cover your methods of data collection and analysis. Present both qualitatitve and quantitative data you collected. Aim to have a clear conclusion, recommendation or insight, based on the data that you have (if the data are not clear, then that can be a clear conclusion of itselft).

Report instructions

Individual report
  • Short reflective piece (around 500+ words).
  • Discuss the key takeaways from the class and from your project
Blogpost (1 per group, mandatory)
  • Write-up of your project on the blog,
  • 1 person per team to email me for
    credentials.
  • The blog is public.
  • Formatting is your responsibility.
  • This is a case-study
  • Your classmates (next year) will
    read this. What you would like to
    know about your project if you
    were the reader?
  • Does not have to be too long,
    some sections can be condensed
    in bullet point (optional).
  • Include images [of the case-study], figures you produced [e.g. the user-journey] and plots from your data. If you use external sources, make sure to credit them.

Suggested sections – but you can adapt

  • Abstract (or exec.summary or TL;DR)
  • Case-study description Describe the ‘system’ you analysed. What is it,
    what is its purpose, who is its main audience? Add any
    information a reader might need to know to understand why
    this is an interested case-study, what is unique about it, etc.
  • Data. What data did you use? What were the sources of the
    data you used? Which data were collected by you and
    which by others? Were they anonymised?
  • Methods. How did you collect data from participants? How
    did you analyse it?
  • Results. What did you find?
  • Insights and Recommendations. Based on your results
    what do you recommend to be done to improve user-experience?