Synthetic users for research: what they are and where they fall short
The pitch for synthetic users is appealing: instant research subjects, any profile, no scheduling required. The problem is that the answers are not real. They are statistically plausible text generated by a language model, not observations of actual human behavior.