Projects per year
Abstract
Large Language Models and chat interfaces like ChatGPT have become increasingly important recently, receiving a lot of attention even from the general public. People use these tools not only to summarize or translate text but also to answer questions, including medical ones. For the latter, giving reliable feedback is of utmost importance, which is hard to assess. Therefore, we focus on validating the feedback of ChatGPT and propose a testing procedure utilizing other medical sources to determine the quality of feedback for more straightforward medical diagnostic tasks. This paper outlines the problem, discusses available sources, and introduces the validation method. Moreover, we present the first results obtained when applying the testing framework to ChatGPT.
Original language | English |
---|---|
Title of host publication | Proceedings of the 27th International Multiconference Information Society – IS 2024 |
Chapter | K |
Pages | 914-919 |
Number of pages | 6 |
DOIs | |
Publication status | Published - Oct 2024 |
Event | 27th International Multiconference Information Society – IS 2024 - Ljubljana, Slovenia Duration: 7 Oct 2024 → 11 Oct 2024 |
Conference
Conference | 27th International Multiconference Information Society – IS 2024 |
---|---|
Abbreviated title | IS 2024 |
Country/Territory | Slovenia |
City | Ljubljana |
Period | 7/10/24 → 11/10/24 |
Keywords
- Large Language Models
- ChatGPT
- NetDoktor
- Testing
- Validation
ASJC Scopus subject areas
- Artificial Intelligence
Fields of Expertise
- Information, Communication & Computing
Fingerprint
Dive into the research topics of 'Testing ChatGPT’s Performance on Medical Diagnostic Tasks'. Together they form a unique fingerprint.Projects
- 1 Active
-
EU - ChatMED - Bridging Research Institutions to Catalyze Generative AI Adoption by the Health Sector in the Widening Countries
Wotawa, F. (Co-Investigator (CoI))
1/09/24 → 31/08/27
Project: Research project
Activities
- 1 Talk at conference or symposium
-
Testing ChatGPT’s Performance on Medical Diagnostic Tasks
Perko, A. (Speaker)
9 Oct 2024Activity: Talk or presentation › Talk at conference or symposium › Science to science