Umeå University's logo

umu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Exploring the impact of varying prompts on the accuracy of database querying with an LLM
Umeå University, Faculty of Science and Technology, Department of Computing Science.
2024 (English)Independent thesis Basic level (degree of Bachelor), 10 credits / 15 HE creditsStudent thesis
Abstract [en]

Large Language Models (LLM) and their abilities of text-to-SQL are today a very relevant topic, as utilizing an LLM as a database interface would facilitate easy access to the data in the database without any prior knowledge of SQL. What is being studied in this thesis, is how to best structure a prompt to increase the accuracy of an LLM on a text-to-SQL task. The methods of experimentation used in the study were experimentation with 5 different prompts, and a total of 22 questions asked about the database with the questions being of difficulties varying from easy to extra hard. The results showed that a simpler, less descriptive prompt performed better on the easy and medium questions, while a more descriptive prompt performed better on the hard and extra hard questions. The f indings did not fully align with the hypothesis that more descriptive prompts would have the most correct outputs. In conclusion, it seemed that prompts that contained less ”clutter” and were more straightforward were more effective on easy questions, while on harder questions a prompt with a better description and examples had a better impact.

Place, publisher, year, edition, pages
2024. , p. 23
Series
UMNAD ; 1478
Keywords [en]
LLM, Database, prompt, prompting, database querying
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:umu:diva-226806OAI: oai:DiVA.org:umu-226806DiVA, id: diva2:1874943
Educational program
Bachelor of Science Programme in Computing Science
Supervisors
Examiners
Available from: 2024-06-26 Created: 2024-06-20 Last updated: 2024-06-26Bibliographically approved

Open Access in DiVA

fulltext(2790 kB)286 downloads
File information
File name FULLTEXT01.pdfFile size 2790 kBChecksum SHA-512
5ceb80c622350f3b8c187dc2b9208904ca6710e9d228cd5f5cd033bea8ee1d5c83e3e64518dbd610b7628fbcb370b56bb957b05a42669b2b0ba0e611628ec5f9
Type fulltextMimetype application/pdf

By organisation
Department of Computing Science
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 286 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 1629 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf