Artificial intelligence applications as a source of information on penis-lengthening and penis girth enhancement: ChatGPT 4o Plus vs. Gemini advanced

Aplicaciones de inteligencia artificial como fuente de información sobre alargamiento de pene y aumento del grosor del pene: ChatGPT 4o Plus vs. Gemini advanced

Background: To evaluate the quality, reliability, and readability of the information provided by artificial intelligence (AI) applications on penis-lengthening and penis girth enhancement, using ChatGPT 4o Plus and Gemini Advanced as examples for the first time. Methods: Frequently asked questions (FAQs) about penis-lengthening and penis girth enhancement were derived from the European Association of Urology (EAU) 2024 guidelines, review articles published in the last five years, Google Trends, health forums, YouTube, Instagram, Twitter and hospital websites. These questions were posed to the November 2024 versions of ChatGPT 4o Plus and Gemini Advanced. The reliability and quality of responses were assessed using the modified Global Quality Score (GQS), divided into reliability (GQS-R) and usefulness (GQS-U) subcategories. Readability was evaluated using the Flesch Reading Ease (FRE) and the Flesch-Kincaid Reading Grade Level (FKRGL) scales. Results were compared using appropriate statistical methods. Results: Both AI applications were asked 62 questions. ChatGPT 4o Plus scored significantly higher than Gemini Advanced on GQS-R and GQS-U (p < 0.001 for both). Gemini Advanced had significantly higher FKRGL scores than ChatGPT 4o Plus (p < 0.001), except for penis lengthening questions, where Gemini Advanced exhibited higher FRE scores. ChatGPT 4o Plus was significantly faster in responding (p = 0.021). Conclusions: Artificial intelligence applications provided high-quality, useful, and reliable information on penis lengthening and penis girth enhancement. However, their readability and comprehensibility remain challenging. ChatGPT 4o Plus delivers information more quickly, reliably and usefully, while Gemini Advanced is more readable and comprehensible.

Resumen

Antecedentes: Evaluar la calidad, fiabilidad y legibilidad de la información proporcionada por aplicaciones de inteligencia artificial (IA) sobre alargamiento de pene y aumento del grosor del pene, utilizando ChatGPT 4o Plus y Gemini Advanced como ejemplos por primera vez. Métodos: Las preguntas frecuentes (FAQs) sobre alargamiento de pene y aumento del grosor del pene se derivaron de las guías de la Asociación Europea de Urología (EAU) 2024, artículos de revisión publicados en los últimos cinco años, Google Trends, foros de salud, YouTube, Instagram, Twitter y sitios web de hospitales. Estas preguntas se plantearon a las versiones de noviembre de 2024 de ChatGPT 4o Plus y Gemini Advanced. La fiabilidad y calidad de las respuestas se evaluaron utilizando el puntaje de calidad global modificado (GQS), dividido en las subcategorías de fiabilidad (GQS-R) y utilidad (GQS-U). La legibilidad se evaluó utilizando las escalas de Facilidad de Lectura de Flesch (FRE) y el Nivel de Grado de Lectura de Flesch-Kincaid (FKRGL). Los resultados se compararon utilizando métodos estadísticos adecuados. Resultados: A ambas aplicaciones de IA se les realizaron 62 preguntas. ChatGPT 4o Plus obtuvo puntajes significativamente más altos que Gemini Advanced en GQS-R y GQS-U (p < 0.001 en ambos casos). Gemini Advanced tuvo puntajes FKRGL significativamente más altos que ChatGPT 4o Plus (p < 0.001), excepto en las preguntas sobre alargamiento del pene, donde Gemini Advanced mostró puntajes FRE más altos. ChatGPT 4o Plus fue significativamente más rápido en responder (p = 0.021). Conclusiones: Las aplicaciones de inteligencia artificial proporcionaron información de alta calidad, útil y confiable sobre el alargamiento del pene y el aumento del grosor del pene. Sin embargo, su legibilidad y comprensibilidad siguen siendo un desafío. ChatGPT 4o Plus ofrece información de manera más rápida, confiable y útil, mientras que Gemini Advanced es más legible y comprensible.

Artificial intelligence; ChatGPT; Gemini; Penis lengthening; Penis girth enhancement

Palabras Clave

Inteligencia artificial; ChatGPT; Gemini; Alargamiento del pene; Aumento del grosor del pene

[1] Baydilli N, Selvi I. Is social media reliable as a source of information on Peyronie’s disease treatment? International Journal of Impotence Research. 2022; 34: 295–301.

[2] Xu AJ, Myrie A, Taylor JI, Matulewicz R, Gao T, Pérez-Rosas V, et al. Instagram and prostate cancer: using validated instruments to assess the quality of information on social media. Prostate Cancer and Prostatic Diseases. 2022; 25: 791–793.

[3] Seranio N, Muncey W, Cox S, Belladelli F, Del Giudice F, Glover F, et al. Size matters: characterizing penile augmentation content from the 100 most popular YouTube videos. International Journal of Impotence Research. 2024; 36: 493–497.

[4] Walker HL, Ghani S, Kuemmerli C, Nebiker CA, Müller BP, Raptis DA, et al. Reliability of medical information provided by ChatGPT: assessment against clinical guidelines and patient information quality instrument. Journal of Medical Internet Research. 2023; 25: e47479.

[5] Roumeliotis KI, Tselikas ND. ChatGPT and Open-AI models: a preliminary review. Future Internet. 2023; 15: 192.

[6] Singh SK, Kumar S, Mehra PS. Chat GPT & Google Bard AI: a review. 2023 International Conference on IoT, Communication and Automation Technology (ICICAT). 23–24 June 2023. IEEE: India. 2023.

[7] Shen Y, Heacock L, Elias J, Hentel KD, Reig B, Shih G, et al. ChatGPT and other large language models are double-edged swords. Radiology. 2023; 307: e230163.

[8] Szczesniewski JJ, Tellez Fouz C, Ramos Alba A, Diaz Goizueta FJ, García Tello A, Llanes González L. ChatGPT and most frequent urological diseases: analysing the quality of information and potential risks for patients. World Journal of Urology. 2023; 41: 3149–3153.

[9] Caglar U, Yildiz O, Meric A, Ayranci A, Gelmis M, Sarilar O, et al. Evaluating the performance of ChatGPT in answering questions related to pediatric urology. Journal of Pediatric Urology. 2024; 20: 26.e1–26.e5.

[10] Yigman M, Untan I, Dogan AE. ChatGPT: a new hope for sexual dysfunction sufferers? Journal of Men’s Health. 2024; 20: 135–140.

[11] Sedaghat S. Early applications of ChatGPT in medical practice, education and research. Clinical Medicine. 2023; 23: 278–279.

[12] Caglar U, Yildiz O, Ozervarli MF, Aydin R, Sarilar O, Ozgor F, et al. Assessing the performance of chat generative pretrained transformer (ChatGPT) in answering andrology-related questions. Urology Research and Practice. 2023; 49: 365–369.

[13] Ergin İE, Sancı A. Can ChatGPT help patients understand their andrological diseases. Revista Internacional de Andrología. 2024; 22: 14–20.

[14] Şahin MF, Keleş A, Özcan R, Doğan Ç, Topkaç EC, Akgül M, et al. Evaluation of information accuracy and clarity: ChatGPT responses to the most frequently asked questions about premature ejaculation. Sexual Medicine. 2024; 12: qfae036.

[15] Aktas B, Demirel D, Celikkaleli F, Bulut S, Ozgur EG, Kizilkan Y, et al. YouTube™ as a source of information on prostatitis: a quality and reliability analysis. International Journal of Impotence Research. 2024; 36: 242–247.

[16] Babar M, Loloi J, Patel RD, Singh S, Azhar U, Maria P, et al. Cross‐sectional and comparative analysis of videos on erectile dysfunction treatment on YouTube and TikTok. Andrologia. 2022; 54: e14392.

[17] Romero‐Otero J, Manfredi C, Ralph D, Osmonov D, Verze P, Castiglione F, et al. Non‐invasive and surgical penile enhancement interventions for aesthetic or therapeutic purposes: a systematic review. BJU International. 2021; 127: 269–291.

[18] Marra G, Drury A, Tran L, Veale D, Muir GH. Systematic review of surgical and nonsurgical interventions in normal men complaining of small penis size. Sexual Medicine Reviews. 2020; 8: 158–180.

[19] Hehemann MC, Towe M, Huynh LM, El-Khatib FM, Yafi FA. Penile girth enlargement strategies: what’s the evidence? Sexual Medicine Reviews. 2019; 7: 535–547.

[20] Bernard A, Langille M, Hughes S, Rose C, Leddin D, Veldhuyzen van Zanten S. A systematic review of patient inflammatory bowel disease information resources on the World Wide Web. The American Journal of Gastroenterology. 2007; 102: 2070–2077.

[21] Jindal P, MacDermid JC. Assessing reading levels of health information: uses and limitations of flesch formula. Education for Health. 2017; 30: 84–88.

[22] Kutner M, Greenburg E, Jin Y, Paulsen C. The health literacy of America’s adults: results from the 2003 national assessment of adult literacy. (NCES 2006-483). Washington, DC: U.S. Department of Education, National Center for Education Statistics; September 2006. 2006.

[23] Liu S, Wright AP, Patterson BL, Wanderer JP, Turer RW, Nelson SD, et al. Using AI-generated suggestions from ChatGPT to optimize clinical decision support. Journal of the American Medical Informatics Association. 2023; 30: 1237–1245.

[24] Miyake Y, Retrosi G, Keijzer R. Artificial intelligence and pediatric surgery: where are we? Pediatric Surgery International. 2025; 41: 19.

[25] Pirkle S, Yang J, Blumberg TJ. Do ChatGPT and Gemini provide apparopriate recommendations for pediatric orthopaedic conditions? Journal of Pediatric Orthopaedics. 2025; 45: e66–e71.

[26] Malak A, Şahin MF. How useful are current chatbots regarding urology patient information? Comparison of the ten most popular chatbots’ responses about female urinary incontinence. Journal of Medical Systems. 2024; 48: 102.

[27] Bülbül E, İlki FY. Assessment of the relationship between the quality of YouTube videos on penile enlargement surgery and scholarly profiles of surgeons. Journal of Urological Surgery. 2024; 11: 105–110.

[28] Çağlayan A, Gül M. #Penisenlargement on Instagram: a mixed-methods study. International Journal of Impotence Research. 2024; 36: 218–222.