Evaluating Large Language Models in Generating Synthetic HCI Research Data: a Case Study

Author:

Hämäläinen Perttu1ORCID,Tavast Mikke1ORCID,Kunnari Anton2ORCID

Affiliation:

1. Aalto University, Finland

2. University of Helsinki, Finland

Funder

Academy of Finland

European Commission Horizon 2020 FET Proactive program

Publisher

ACM

Reference88 articles.

1. Alexander  L Anwyl-Irvine , Jessica Massonnié , Adam Flitton , Natasha Kirkham , and Jo  K Evershed . 2020. Gorilla in our midst: An online behavioral experiment builder. Behavior research methods 52, 1 ( 2020 ), 388–407. https://doi.org/10.3758/s13428-019-01237-x 10.3758/s13428-019-01237-x Alexander L Anwyl-Irvine, Jessica Massonnié, Adam Flitton, Natasha Kirkham, and Jo K Evershed. 2020. Gorilla in our midst: An online behavioral experiment builder. Behavior research methods 52, 1 (2020), 388–407. https://doi.org/10.3758/s13428-019-01237-x

2. Lisa  P Argyle , Ethan  C Busby , Nancy Fulda , Joshua Gubler , Christopher Rytting , and David Wingate . 2022. Out of One , Many : Using Language Models to Simulate Human Samples . arXiv preprint arXiv:2209.06899( 2022 ). https://doi.org/10.48550/arXiv.2209.06899 10.48550/arXiv.2209.06899 Lisa P Argyle, Ethan C Busby, Nancy Fulda, Joshua Gubler, Christopher Rytting, and David Wingate. 2022. Out of One, Many: Using Language Models to Simulate Human Samples. arXiv preprint arXiv:2209.06899(2022). https://doi.org/10.48550/arXiv.2209.06899

3. Javier  A. Bargas-Avila and Kasper Hornbæk. 2011. Old Wine in New Bottles or Novel Challenges: A Critical Analysis of Empirical Studies of User Experience . In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Association for Computing Machinery , New York, NY, USA, 2689–2698. https://doi.org/10.1145/ 1978 942.1979336 10.1145/1978942.1979336 Javier A. Bargas-Avila and Kasper Hornbæk. 2011. Old Wine in New Bottles or Novel Challenges: A Critical Analysis of Empirical Studies of User Experience. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 2689–2698. https://doi.org/10.1145/1978942.1979336

4. Etienne Becht , Leland McInnes , John Healy , Charles-Antoine Dutertre , Immanuel  WH Kwok , Lai Guan Ng , Florent Ginhoux , and Evan  W Newell . 2019. Dimensionality reduction for visualizing single-cell data using UMAP. Nature biotechnology 37, 1 ( 2019 ), 38–44. https://doi.org/10.1038/nbt.4314 10.1038/nbt.4314 Etienne Becht, Leland McInnes, John Healy, Charles-Antoine Dutertre, Immanuel WH Kwok, Lai Guan Ng, Florent Ginhoux, and Evan W Newell. 2019. Dimensionality reduction for visualizing single-cell data using UMAP. Nature biotechnology 37, 1 (2019), 38–44. https://doi.org/10.1038/nbt.4314

5. Representation Learning: A Review and New Perspectives

Cited by 55 articles. 订阅此论文施引文献 订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献

1. A technological construction of society: Comparing GPT‐4 and human respondents for occupational evaluation in the UK;British Journal of Industrial Relations;2024-08-14

2. Can GPT-4 Replicate Empirical Software Engineering Research?;Proceedings of the ACM on Software Engineering;2024-07-12

3. Large Language Models and Video Games: A Preliminary Scoping Review;ACM Conversational User Interfaces 2024;2024-07-08

4. Understanding Human-AI Workflows for Generating Personas;Designing Interactive Systems Conference;2024-07

5. Teacher, Trainer, Counsel, Spy: How Generative AI can Bridge or Widen the Gaps in Worker-Centric Digital Phenotyping of Wellbeing;Proceedings of the 3rd Annual Meeting of the Symposium on Human-Computer Interaction for Work;2024-06-25

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3