Toward Value Scenario Generation Through Large Language Models

Hyunggu Jung; Woosuk Seo; Seokwoo Song; Sungmin Na

doi:10.1145/3584931.3606960

Toward Value Scenario Generation Through Large Language Models

Hyunggu Jung, Woosuk Seo, Seokwoo Song, Sungmin Na

Department of Computer Science and Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

1 Scopus citations

Abstract

We propose a method of generating value scenarios for design research by leveraging ChatGPT, an AI-powered chatbot based on large language models. Identifying the needs of a vulnerable population, such as North Korean defectors, is challenging for researchers. To address this, we introduce ChatGPT-generated value scenarios, an extension of scenario-based design that supports critical, systemic, long-term thinking in current design practice, technology development, and deployment. Using our proposed method, we created a prompt to generate value scenarios on ChatGPT. Based on our analysis of the generated scenarios, we identified that ChatGPT could generate plausible information about Value Implications. However, it lacks details on Pervasiveness and Systemic Effects. After discussing the limitations and opportunities of ChatGPT in generating value scenarios, we conclude with suggestions for how ChatGPT might be better used to generate value scenarios.

Original language	English
Title of host publication	CSCW 2023 Companion - Conference Companion Publication of the 2023 Computer Supported Cooperative Work and Social Computing
Editors	Morgan Ames, Susan Fussell, Eric Gilbert, Vera Liao, Xiaojuan Ma, Xinru Page, Mark Rouncefield, Vivek Singh, Pamela Wisniewski
Publisher	Association for Computing Machinery
Pages	212-220
Number of pages	9
ISBN (Electronic)	9798400701290
DOIs	https://doi.org/10.1145/3584931.3606960
State	Published - 14 Oct 2023
Event	26th ACM Conference on Computer-Supported Cooperative Work and Social Computing, CSCW 2023 - Minneapolis, United States Duration: 14 Oct 2023 → 18 Oct 2023

Publication series

Name	Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW

Conference

Conference	26th ACM Conference on Computer-Supported Cooperative Work and Social Computing, CSCW 2023
Country/Territory	United States
City	Minneapolis
Period	14/10/23 → 18/10/23

Keywords

ChatGPT
large language models
value scenarios

Access to Document

10.1145/3584931.3606960

Cite this

Jung, H., Seo, W., Song, S., & Na, S. (2023). Toward Value Scenario Generation Through Large Language Models. In M. Ames, S. Fussell, E. Gilbert, V. Liao, X. Ma, X. Page, M. Rouncefield, V. Singh, & P. Wisniewski (Eds.), CSCW 2023 Companion - Conference Companion Publication of the 2023 Computer Supported Cooperative Work and Social Computing (pp. 212-220). (Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW). Association for Computing Machinery. https://doi.org/10.1145/3584931.3606960

Jung, Hyunggu ; Seo, Woosuk ; Song, Seokwoo et al. / Toward Value Scenario Generation Through Large Language Models. CSCW 2023 Companion - Conference Companion Publication of the 2023 Computer Supported Cooperative Work and Social Computing. editor / Morgan Ames ; Susan Fussell ; Eric Gilbert ; Vera Liao ; Xiaojuan Ma ; Xinru Page ; Mark Rouncefield ; Vivek Singh ; Pamela Wisniewski. Association for Computing Machinery, 2023. pp. 212-220 (Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW).

@inproceedings{0b2e4cced25b4cc5954c7a1d415ccaa5,

title = "Toward Value Scenario Generation Through Large Language Models",

abstract = "We propose a method of generating value scenarios for design research by leveraging ChatGPT, an AI-powered chatbot based on large language models. Identifying the needs of a vulnerable population, such as North Korean defectors, is challenging for researchers. To address this, we introduce ChatGPT-generated value scenarios, an extension of scenario-based design that supports critical, systemic, long-term thinking in current design practice, technology development, and deployment. Using our proposed method, we created a prompt to generate value scenarios on ChatGPT. Based on our analysis of the generated scenarios, we identified that ChatGPT could generate plausible information about Value Implications. However, it lacks details on Pervasiveness and Systemic Effects. After discussing the limitations and opportunities of ChatGPT in generating value scenarios, we conclude with suggestions for how ChatGPT might be better used to generate value scenarios.",

keywords = "ChatGPT, large language models, value scenarios",

author = "Hyunggu Jung and Woosuk Seo and Seokwoo Song and Sungmin Na",

note = "Publisher Copyright: {\textcopyright} 2023 ACM.; 26th ACM Conference on Computer-Supported Cooperative Work and Social Computing, CSCW 2023 ; Conference date: 14-10-2023 Through 18-10-2023",

year = "2023",

month = oct,

day = "14",

doi = "10.1145/3584931.3606960",

language = "English",

series = "Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW",

publisher = "Association for Computing Machinery",

pages = "212--220",

editor = "Morgan Ames and Susan Fussell and Eric Gilbert and Vera Liao and Xiaojuan Ma and Xinru Page and Mark Rouncefield and Vivek Singh and Pamela Wisniewski",

booktitle = "CSCW 2023 Companion - Conference Companion Publication of the 2023 Computer Supported Cooperative Work and Social Computing",

}

Jung, H, Seo, W, Song, S & Na, S 2023, Toward Value Scenario Generation Through Large Language Models. in M Ames, S Fussell, E Gilbert, V Liao, X Ma, X Page, M Rouncefield, V Singh & P Wisniewski (eds), CSCW 2023 Companion - Conference Companion Publication of the 2023 Computer Supported Cooperative Work and Social Computing. Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW, Association for Computing Machinery, pp. 212-220, 26th ACM Conference on Computer-Supported Cooperative Work and Social Computing, CSCW 2023, Minneapolis, United States, 14/10/23. https://doi.org/10.1145/3584931.3606960

Toward Value Scenario Generation Through Large Language Models. / Jung, Hyunggu; Seo, Woosuk; Song, Seokwoo et al.
CSCW 2023 Companion - Conference Companion Publication of the 2023 Computer Supported Cooperative Work and Social Computing. ed. / Morgan Ames; Susan Fussell; Eric Gilbert; Vera Liao; Xiaojuan Ma; Xinru Page; Mark Rouncefield; Vivek Singh; Pamela Wisniewski. Association for Computing Machinery, 2023. p. 212-220 (Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Toward Value Scenario Generation Through Large Language Models

AU - Jung, Hyunggu

AU - Seo, Woosuk

AU - Song, Seokwoo

AU - Na, Sungmin

PY - 2023/10/14

Y1 - 2023/10/14

N2 - We propose a method of generating value scenarios for design research by leveraging ChatGPT, an AI-powered chatbot based on large language models. Identifying the needs of a vulnerable population, such as North Korean defectors, is challenging for researchers. To address this, we introduce ChatGPT-generated value scenarios, an extension of scenario-based design that supports critical, systemic, long-term thinking in current design practice, technology development, and deployment. Using our proposed method, we created a prompt to generate value scenarios on ChatGPT. Based on our analysis of the generated scenarios, we identified that ChatGPT could generate plausible information about Value Implications. However, it lacks details on Pervasiveness and Systemic Effects. After discussing the limitations and opportunities of ChatGPT in generating value scenarios, we conclude with suggestions for how ChatGPT might be better used to generate value scenarios.

AB - We propose a method of generating value scenarios for design research by leveraging ChatGPT, an AI-powered chatbot based on large language models. Identifying the needs of a vulnerable population, such as North Korean defectors, is challenging for researchers. To address this, we introduce ChatGPT-generated value scenarios, an extension of scenario-based design that supports critical, systemic, long-term thinking in current design practice, technology development, and deployment. Using our proposed method, we created a prompt to generate value scenarios on ChatGPT. Based on our analysis of the generated scenarios, we identified that ChatGPT could generate plausible information about Value Implications. However, it lacks details on Pervasiveness and Systemic Effects. After discussing the limitations and opportunities of ChatGPT in generating value scenarios, we conclude with suggestions for how ChatGPT might be better used to generate value scenarios.

KW - ChatGPT

KW - large language models

KW - value scenarios

UR - http://www.scopus.com/inward/record.url?scp=85176281944&partnerID=8YFLogxK

U2 - 10.1145/3584931.3606960

DO - 10.1145/3584931.3606960

M3 - Conference contribution

AN - SCOPUS:85176281944

T3 - Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW

SP - 212

EP - 220

BT - CSCW 2023 Companion - Conference Companion Publication of the 2023 Computer Supported Cooperative Work and Social Computing

A2 - Ames, Morgan

A2 - Fussell, Susan

A2 - Gilbert, Eric

A2 - Liao, Vera

A2 - Ma, Xiaojuan

A2 - Page, Xinru

A2 - Rouncefield, Mark

A2 - Singh, Vivek

A2 - Wisniewski, Pamela

PB - Association for Computing Machinery

T2 - 26th ACM Conference on Computer-Supported Cooperative Work and Social Computing, CSCW 2023

Y2 - 14 October 2023 through 18 October 2023

ER -

Jung H, Seo W, Song S, Na S. Toward Value Scenario Generation Through Large Language Models. In Ames M, Fussell S, Gilbert E, Liao V, Ma X, Page X, Rouncefield M, Singh V, Wisniewski P, editors, CSCW 2023 Companion - Conference Companion Publication of the 2023 Computer Supported Cooperative Work and Social Computing. Association for Computing Machinery. 2023. p. 212-220. (Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW). doi: 10.1145/3584931.3606960

Toward Value Scenario Generation Through Large Language Models

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this