MeTA-Edu: a new methodology for validating educational technologies applied to COVID-19 prevention in adults with cancer

Authors

  • Isabella Portugal, MD-MSc Medical Sciences Postgraduate Program. Department of Internal Medicine. University of São Paulo Medical School. São Paulo, São Paulo, Brazil. https://orcid.org/0000-0002-6448-2550
  • Ítalla Maria Pinheiro Bezerra, PhD Escola Superior de Ciências da Santa Casa de Misericórdia de Vitória. Vitória, Espírito Santo, Brazil.
  • Alvaro Dantas de Almeida Junior a Programa de Pós-graduação em Ciências Médicas. Faculdade de Medicina. Universidade de São Paulo, Brazil.
  • Blanca Elena Guerrero Daboin, PhD Federal University of Espírito Santo. Vitória, Espírito Santo, Brazil https://orcid.org/0000-0001-9052-1923
  • Hugo Zucaratto Zucoloto Federal University of Espírito Santo. Vitória, Espírito Santo, Brazil https://orcid.org/0000-0002-7223-3271
  • Sabrina Alaide Amorim Alves b Escola Superior de Ciências da Santa Casa de Misericórdia de Vitória. Vitória, Espírito Santo; d Universidade Estadual do Ceará, Ceará, Brasil.
  • Carlos Eduardo Siqueira, MD-PhD University of Massachusetts. Boston, Massachusetts, United States.
  • Luiz Carlos de Abreu, PhD Medical Sciences Postgraduate Program. Department of Internal Medicine. University of São Paulo Medical School. São Paulo, São Paulo, Brazil.

DOI:

https://doi.org/10.36311/jhgd.v33.13830

Keywords:

Validation studies, Educational Technologies, Neoplasms, Betacoronavirus, Health Promotion

Abstract

Introduction: validated educational technologies favor access to reliable and adequate information, representing a critical risk communication tool for cancer patients during public health emergencies.

Objective: to assess the validity and reliability of an electronic booklet on COVID-19 for adults with cancer.

Methods: methodological validation by a panel of 22 experts linked to Brazil’s national curriculum vitae database. Sampling was performed by convenience, snowball, and selection techniques according to Jasper’s criteria. The validity of the booklet was evaluated by an electronic questionnaire using the content validity index (CVI), intraclass correlation coefficient (ICC), the suitability assessment of materials (SAM) instrument, and the metalinguistic thematic analysis for educational technologies (MeTA-Edu) of dissertation proposals.

Results: the expert panel consisted of 22 doctors with homogeneous sociodemographic characteristics, high specialization in education (86.4%), and teaching experience (average = 17.8 years). In general, the educational technology was validated by experts for content (overall CVI = 0.953) with a high degree of agreement (ICC = 0.958) and suitability of the content, literacy demand, graphics, layout, and typography, learning stimulation and motivation, and cultural appropriateness (SAM = 90.6%). After thematic analysis, 94 dissertation proposals were identified, mainly of the visual language type (47.9%) and referential/informative function (68.1%). Most expert suggestions were accepted (83.0%), and only 17.0% were rejected.

Conclusion: the validity and reliability of the booklet “Uncomplicating COVID-19 for people with cancer” were ratified by experts. These findings can contribute to the methodological optimization of the validation of educational technologies and innovation of health education strategies, subsidizing cancer care in times of crisis.

Downloads

Download data is not yet available.

References

Ferlay J, Colombet M, Soerjomataram I, Parkin DM, Piñeros M, Znaor A, et al. Cancer statistics for the year 2020: An overview. Int J Cancer. 2021 Apr 5;149(4):778–89.

Zaorsky NG, Churilla TM, Egleston BL, Fisher SG, Ridge JA, Horwitz EM, et al. Causes of death among cancer patients. Ann Oncol. 2017 Feb 1;28(2):400-7.

Nana-Sinkam SP, Crouser ED. Altered immune surveillance: a common link between cancer and sepsis? Crit Care Med. 2021 Mar 31;38(3):1000-1.

Corrêa LC, Teles D, Silva OBD, Trindade-Filho GH, Loureiro P, Cavalcati MDSM. Predictors of mortality among patients with acute leukemias admitted to an intensive care unit specialized in patients with hematological disease at a Brazilian hospital. Hematol Transfus Cell Ther. 2019 Apr 26;42(1):33-39.

WHO-China Joint Mission. Report of the WHO-China Joint Mission on Coronavirus Disease 2019 (COVID-19). Beijing: World Health Organization[Internet]. 2020 Feb 16-24 [cited 2022 May 6]. Available from: https://www.who.int/docs/default-source/coronaviruse/who-china-joint-mission-on-covid-19-final-report.pdf

Jardim BC, Migowski A, Corrêa FM, Silva GAE. Covid-19 in Brazil in 2020: impact on deaths from cancer and cardiovascular diseases. Rev Saude Publica. 2022 Apr 22;56:22.

Atty AT de M, Jardim BC, Dias MBK, Migowski A, Tomazelli JG. PAINEL-Oncologia: uma Ferramenta de Gestão. Revista Brasileira de Cancerologia [Internet]. 2020 Apr 30 [cited 2022 May 6];66(2):e-04827. Available from: https://rbc.inca.gov.br/index.php/revista/article/view/827

Verma R, Saldanha C, Ellis U, Sattar S, Haase KR. eHealth literacy among older adults living with cancer and their caregivers: A scoping review. J Geriatr Oncol. 2022 Jun 1;13(5):555–62.

Rudd RE. Needed action in health literacy. J Health Psychol. 2013 Aug;18(8):1004–10.

Al-Shamsi HO, Alhazzani W, Alhuraiji A, Coomes EA, Chemaly RF, Almuhanna M, et al. A Practical Approach to the Management of Cancer Patients During the Novel Coronavirus Disease 2019 (COVID-19) Pandemic: An International Collaborative Group. Oncologist. 2020 Jun 1;25(6):e936–45.

Sauer MA, Truelove S, Gerste AK, Limaye RJ. A Failure to Communicate? How Public Messaging Has Strained the COVID-19 Response in the United States. Health Secur. 2021 Jan-Feb;19(1):65-74.

Bezerra IMP, Alves SAA, de Fátima Antero Sousa Machado M, Zioni F, de Lima Antão JYF, Martins AAA, et al. Health education for seniors: An analysis in light of Paulo Freire’s perspective. Int Arch Med. 2015 March 5;8(1).

Freire P. Pedagogia do Oprimido. 42. ed. Rio de Janeiro: Paz e Terra, 2005.

Office of the Federal Register NA and RA. Public Law 111 - 274 - Plain Writing Act of 2010 [Internet]. 2010 Oct 13 [cited 2022 Aug 19]. Available from: https://www.govinfo.gov/content/pkg/PLAW-111publ274/pdf/PLAW-111publ274.pdf

Santos SB dos, Machado APDA, Sampaio LA, Abreu LC de, Bezerra IMP. Sífilis adquirida: construção e validação de tecnologia educativa para adolescentes. J. Hum. Growth Dev. 2019 Apr;29(1):65–74.

Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. 2007 Aug;30(4):459-67.

Lopes MV, Silva VM, Araujo TL. Validação de diagnósticos de enfermagem: desafios e alternativas [Validation of nursing diagnosis: challenges and alternatives]. Rev Bras Enferm. 2013 Sep-Oct;66(5):649-55. Portuguese.

Vitor AF. Revisão do Resultado de Enfermagem comportamento de prevenção de quedas: análise de conceito e validação por especialistas [dissertation]. Fortaleza (CE): Universidade Federal do Ceará; 2010.

Jasper MA. Expert: a discussion of the implications of the concept as used in nursing. J Adv Nurs. 1994 Oct;20(4):769-76.

Oliveira SC de. Efeito de uma intervenção educativa na gravidez para alimentação saudável com os alimentos regionais [dissertation]. Fortaleza (CE): Universidade Federal do Ceará; 2014.

Moraes, SDTA. Método científico e pesquisas em saúde: orientação para prática profissional. J. Hum. Growth Dev. 2019 Apr;29(1):5–9.

Rubio DMG, Berg-Weger M, Tebb SS, Lee ES, Rauch S. Objectifying content validity: Conducting a content validity study in social work research. Soc Work Res. 2003 Jun 1;27(2):94–104.

Kusi Amponsah A, Bam V, Stolt M, Korhonen J, Axelin A. Evaluating the content validity of two versions of an instrument used in measuring pediatric pain knowledge and attitudes in the Ghanaian context. PLoS One. 2020 Nov 6;15(11):e0241983.

Doak LG, Doak CC, Meade CD. Strategies to improve cancer education materials. Oncol Nurs Forum. 1996 Sep;23(8):1305-12.

Brasil. Carta Circular no1/2021 -CONEP/SECNS/MS [Internet]. Brasília: Ministério da Saúde. Secretaria Executiva do Conselho Nacional de Saúde. Comissão Nacional de Ética em Pesquisa; Mar 3, 2021 p. 1–5. Available from: https://conselho.saude.gov.br/images/comissoes/conep/documentos/CARTAS/Carta_Circular_01.2021.pdf

Brasil. Resolução no 466, de 12 de dezembro de 2012. [Internet]. Brasília: Conselho Nacional de Saúde; Dec 12, 2012 p. 1–12. Available from: http://www.conselho.saude.gov.br/resolucoes/2012/Reso466.pdf

Jin R, Simmons C, Lim HJ, Ingledew PA. An Evaluation of the Quality of COVID-19 Internet Resources for Cancer Patients. J Cancer Educ. 2022 Jun 20:1–9.

PAHO. Fact-sheet: If I have Cancer, what do I need to know about COVID-19? [Internet]. IRIS. 2020 [cited 2022 Aug 7]. Available from: https://iris.paho.org/bitstream/handle/10665.2/52202/PAHONMHNVCOVID-19200013_eng.pdf

Bana M, Ribi K, Kropf-Staub S, Näf E, Schramm MS, Zürcher-Florin S, Peters S, Eicher M. Development and implementation strategies of a nurse-led symptom self-management program in outpatient cancer centres: The Symptom Navi© Programme. Eur J Oncol Nurs. 2020 Feb 1;44:101714.

Kropf-Staub S, Sailer Schramm M, Preusse-Bleuer B, Eicher M, Zürcher S. Flyer Symptom Navi zur Unterstützung des Selbstmanagements von Symptomen bei Krebs – Evaluation von Anwendbarkeit und Verständlichkeit [Flyer to improve self-management of symptoms for patients with cancer – Evaluation of feasibility and comprehensibility of the Symptom Navi]. Pflege. 2017;30(3):151-160. German.

Finnie RK, Felder TM, Linder SK, Mullen PD. Beyond reading level: a systematic review of the suitability of cancer education print and Web-based materials. J Cancer Educ. 2010 Dec;25(4):497-505.

Houts PS, Doak CC, Doak LG, Loscalzo MJ. The role of pictures in improving health communication: a review of research on attention, comprehension, recall, and adherence. Patient Educ Couns. 2006 May;61(2):173–90.

Warde F, Papadakos J, Papadakos T, Rodin D, Salhia M, Giuliani M. Plain language communication as a priority competency for medical professionals in a globalized world. Can Med Educ J. 2018 May 31;9(2):e52-e59.

Tran BNN, Ruan QZ, Epstein S, Ricci JA, Rudd RE, Lee BT. Literacy analysis of National Comprehensive Cancer Network patient guidelines for the most common malignancies in the United States. Cancer. 2018 Feb 15;124(4):769-774.

Nejati B, Lin CC, Aaronson NK, Cheng ASK, Browall M, Lin CY, Broström A, Pakpour AH. Determinants of satisfactory patient communication and shared decision making in patients with multiple myeloma. Psychooncology. 2019 Jul 31;28(7):1490-1497.

Freire P. Educação e mudança. 13. ed. Rio de Janeiro-RJ : Paz e Terra, 1987. 79p.

Vasconcellos-Guedes L, Guedes, LFA. E-surveys: Vantagens e limitações dos questionários eletrônicos via internet no contexto da pesquisa científica. In: X SemeAd-Seminário em Administração FEA/USP. 2007.

Downloads

Published

2023-03-23

Issue

Section

ORIGINAL ARTICLES