Hacking by the prompt: Innovative ways to utilize ChatGPT for evaluators

Resource type
Author/contributor
Title
Hacking by the prompt: Innovative ways to utilize ChatGPT for evaluators
Abstract
“Hacking by the prompt”—writing simple yet creative conversational instructions in ChatGPT's message window—revealed many valuable additions to the evaluator's toolbox for all stages of the evaluation process. This includes the production of terms of reference and proposals for the dissemination of final reports. ChatGPT does not come with an instruction book, so evaluators must experiment creatively to understand its potential. The surprising performance of ChatGPT leads to the question: will it eventually substitute for evaluators? By describing ChatGPT through four personality characteristics (pedantic, “I know it all,” meek, and “speech virtuoso”), this article provides case examples of the potential and pitfall of ChatGPT in transforming evaluation practice. Anthropomorphizing ChatGPT is debatable, but the result is clear: tongue-in-cheek personality characteristics helped hack ChatGPT more creatively while remaining aware of its challenges. This article combines practical ideas with deeper reflection on evaluation. It concludes that ChatGPT can substitute for evaluators when evaluations mostly focus on paperwork and conventional approaches “by the book” (an unfortunate trend in the sector). ChatGPT cannot substitute engagement with reality and critical thinking. Will ChatGPT then be a stimulus to rediscover the humanity and the reality we lost in processes?
Publication
New Directions for Evaluation
Volume
2023
Issue
178-179
Pages
73-84
Date
2023
Language
en
ISSN
1534-875X
Short Title
Hacking by the prompt
Accessed
11/12/2023, 09:47
Library Catalogue
Wiley Online Library
Rights
© 2023 American Evaluation Association and Wiley Periodicals LLC.
Citation
Ferretti, S. (2023). Hacking by the prompt: Innovative ways to utilize ChatGPT for evaluators. New Directions for Evaluation, 2023(178–179), 73–84. https://doi.org/10.1002/ev.20557