Mostrar el registro sencillo del ítem

dc.contributor.authorPehlivanoglu, Meltem Kurt
dc.contributor.authorAbdan Syakura, Muhammad
dc.contributor.authorde-la-Fuente-Valentín, Luis
dc.contributor.authorTadesse Gobosho, Robera
dc.contributor.authorShanmuganathan, Vimal
dc.date2024
dc.date.accessioned2024-12-09T11:19:35Z
dc.date.available2024-12-09T11:19:35Z
dc.identifier.citationKurt Pehlivanoğlu, M., Gobosho, R. T., Syakura, M. A., Shanmuganathan, V., & de-la-Fuente-Valentín, L. (2024). Comparative analysis of paraphrasing performance of ChatGPT, GPT-3, and T5 language models using a new ChatGPT generated dataset: ParaGPT. Expert Systems, 41(11), e13699. https://doi.org/10.1111/exsy.13699es_ES
dc.identifier.issn1468-0394
dc.identifier.issn0266-4720
dc.identifier.urihttps://reunir.unir.net/handle/123456789/17523
dc.description.abstractParaphrase generation is a fundamental natural language processing (NLP) task that refers to the process of generating a well-formed and coherent output sentence that exhibits both syntactic and/or lexical diversity from the input sentence, while simultaneously ensuring that the semantic similarity between the two sentences is preserved. However, the availability of high quality paraphrase datasets has been limited, particularly for machine-generated sentences. In this paper, we present ParaGPT, a new paraphrase dataset of 81,000 machine-generated sentence pairs, including 27,000 reference sentences (ChatGPT-generated sentences), and 81,000 paraphrases obtained by using three different large language models (LLMs): ChatGPT, GPT-3, and T5. We used ChatGPT to generate 27,000 sentences that cover a diverse array of topics and sentence structures, thus providing diverse inputs for the models. In addition, we evaluated the quality of the generated paraphrases using various automatic evaluation metrics. Furthermore, we provide insights into the strengths and drawbacks of each LLM in generating paraphrases by conducting a comparative analysis of the paraphrasing performance of the three LLMs. According to our findings, ChatGPT's performance, as per the evaluation metrics provided, was deemed impressive and commendable, owing to its higher-than-average scores for semantic similarity, which implies a higher degree of similarity between the generated paraphrase and the reference sentence, and its relatively lower scores for syntactic diversity, indicating a greater diversity of syntactic structures in the generated paraphrase. ParaGPT is a valuable resource for researchers working on NLP tasks like paraphrasing, text simplification, and text generation. We make the ParaGPT dataset publicly accessible to researchers, and as far as we are aware, this is the first paraphrase dataset produced based on ChatGPTes_ES
dc.language.isoenges_ES
dc.publisherExpert Systemses_ES
dc.relation.ispartofseries;vol. 41, n. 11
dc.relation.urihttps://onlinelibrary.wiley.com/doi/10.1111/exsy.13699es_ES
dc.rightsopenAccesses_ES
dc.subjectChatGPTes_ES
dc.subjectgenerative artificial intelligencees_ES
dc.subjectlarge language modelses_ES
dc.subjectmachine learninges_ES
dc.titleComparative analysis of paraphrasing performanceof ChatGPT, GPT-3, and T5 language modelsusing a new ChatGPT generated dataset: ParaGPTes_ES
dc.typearticlees_ES
reunir.tag~OPUes_ES
dc.identifier.doihttps://doi.org/10.1111/exsy.13699


Ficheros en el ítem

Thumbnail

Este ítem aparece en la(s) siguiente(s) colección(ones)

Mostrar el registro sencillo del ítem