Mapeamento da Detecção de Deepfakes
um trabalho terminológico
DOI:
https://doi.org/10.36311/1981-1640.2022.v16.e02153Keywords:
Desinformação., Redes Adversariais Generativas (GAN)., Organização do Conhecimento., Terminologia., Deep-fakes.Abstract
The audiovisual documents artificially generated/modifiers, named deep-fakes, can be used by disinformation propagation and, in the opposite direction, have researches for your detection. In order to propose a deep-fake detection domain mapping, this study propose the bibliographic analysis (terms/concepts selection) in the Knowledge Organization, Terminology, and Information Architecture interdisciplinarity as a way. The objectives are: realize terminological mapping on deep-fake detection domain and verifier possible theoretical relationship between interdisciplinary basis selected. The inductive method it went selected by bibliographic survey and domain mapping from exploratory-descriptive research of applied qualitative approach to bibliographies recovered. The theoretical basis was analyzed in a qualitative, reflexive, and critical perspective. The bibliographic survey occurred in Web of Science, Scopus (Elsevier), and Association for Computing Machinery repositories. The theoretical-epistemological cut demonstrated application possibilities in web-domains. It went identifiers 22 papers with context and propositions of deep-fake detection and others detection techniques of artificial manipulation/generation of audiovisual documents resulting in list with 78 candidate’s terms. In conclusion, believe that are necessity of new studies in the domain because the results indicate to a largest domain than exclusively deep-fake techniques with Generative Adversarial Networks use.
Downloads
References
Araújo, Carlos Alberto Ávila. “Novos desafios epistemológicos para a Ciência da Informação.” Palabra Clave (La Plata), vol. 10, no. 2, Apr./Sep. 2021, pp. 1-15. https://www.palabraclave.fahce.unlp.edu.ar/article/view/PCe116/13767. Acessado 06 jul. 2022.
Baek, Jae-Young. Yoo, Young-Sang. Bae, Seung-Hwan. “Generative adversarial ensemble learning for face forensics.” IEEE Access, vol. 8, Mar. 2020, pp. 45421-45431. https://doi.org/10.1109/ACCESS.2020.2968612. Acessado 06 jul. 2022.
Baldinger, Kurt. “Semasiologia e onomasiologia.” ALFA: Revista de Linguística, vol. 9, 2001, pp. 7-36. https://periodicos.fclar.unesp.br/alfa/article/view/3265. Acessado 06 jul. 2022.
Bradshaw, Samantha. Howard, Philip N. “The global disinformation order: 2019. Global inventory of organized social media manipulation.” The Computational Propaganda Project at the Oxford Internet Institute, 2019, pp. 1-23. https://demtech.oii.ox.ac.uk/wp-content/uploads/sites/93/2019/09/CyberTroop-Report19.pdf. Acessado 06 jul. 2022.
Capurro, Rafael. Hjørland, Birger. “O conceito de informação.” Perspectivas em Ciência da Informação, vol. 12, no. 1, Jan./Apr. 2007, pp. 148-207. http://portaldeperiodicos.eci.ufmg.br/index.php/pci/article/view/54/47. Acessado 06 jul. 2022.
Chintha, Akash, et al. “Recurrent convolutional structures for audio spoof and video deepfake detection.” IEEE Journal of Selected Topics in Signal Processing, vol. 14, no. 5, Aug. 2020, pp. 1024-1037. https://doi.org/10.1109/JSTSP.2020.2999185. Acessado 06 jul. 2022.
Echizen, Isao, et al. “Generation and Detection of media clones.” IEICE Transactions on Information and Systems, vol. 104, no. 1, Jan. 2021, pp. 12-23. https://doi.org/10.1587/transinf.2020MUI0002 Acessado 06 jul. 2022.
Fernando, Tharindu, et al. “Detection of fake and fraudulent faces via neural memory networks.” IEEE Transactions on Information Forensics and Security, vol. 16, Dec. 2020, pp. 1973-1988. https://doi.org/10.1109/TIFS.2020.3047768 Acessado 06 jul. 2022.
Froehlich, Thomas J. “Ten lessons for the age of disinformation.” Navigating fake news, alternative facts, and misinformation in a post-truth world, 2020, pp. 36-88. IGI Global. https://www.igi-global.com/book/navigating-fake-news-alternative-facts/236998. Acessado 06 jul. 2022.
Gil, Antônio Carlos. Métodos e técnicas de pesquisa social. Atlas, 2008.
Golub, Koraljka, et al. “Terminology registries for knowledge organization systems: Functionality, use, and attributes.” Journal of the Association for Information Science and Technology, vol. 65, no. 9, 2014, pp. 1901-1916. Wiley, https://doi.org/10.1002/asi.23090. Acessado 06 jul. 2022.
Gomes, Hagar Espanha. “Marcos históricos e teóricos da organização do conhecimento.” Informação & Informação, vol. 22, no. 2, 29 Oct. 2017, pp. 33-66. http://dx.doi.org/10.5433/1981-8920.2017v22n2p33. Acessado 06 jul. 2022.
Gong, Dafeng, et al. “Deepfake forensics, an ai-synthesized detection with deep convolutional generative adversarial networks.” International Journal of Advanced Trends in Computer Science and Engineering, vol. 9, no. 3, 25 Jun. 2020, pp. 2861-2870. Warse, https://doi.org/10.30534/ijatcse/2020/58932020. Acessado 06 jul. 2022.
Greengard, Samuel. “Will deepfakes do deep damage?” Communications of the ACM, vol. 63, no. 1, Jan. 2020, pp. 17-19. https://dl.acm.org/doi/10.1145/3371409 Acessado 06 jul. 2022.
Guarnera, Luca. Giudice, Oliver. Battiato, Sebastiano. “Fighting deepfake by exposing the convolutional traces on images.” IEEE Access, vol. 8, Sep. 2020, pp. 165085-165098. https://doi.org/10.1109/ACCESS.2020.3023037 Acessado 06 jul. 2022.
Guo, Zhiqing, et al. “Fake face detection via adaptive manipulation traces extraction network.” Computer Vision and Image Understanding, vol. 204, 21 Jan. 2021, pp. 1-12. Scopus (Elsevier), https://doi.org/10.1016/j.cviu.2021.103170 Acessado 06 jul. 2022.
Hashmi, Mohammad Farukh, et al. “An exploratory analysis on visual counterfeits using Conv-LSTM hybrid architecture.” IEEE Access, vol 8, May 2020, pp. 101293-101308. https://doi.org/10.1109/ACCESS.2020.2998330. Acessado 06 jul. 2022.
Hjørland, Birger. “Semantics and knowledge organization.” Annual Review of Information Science and Technology, vol. 41, 2007, p. 367-405. WILEY, https://doi.org/10.1002/aris.2007.1440410115 Acessado 06 jul. 2022.
Jung, Tachkyun. Kim, Sangwon. Kim, Keecheon. “DeepVision: deepfakes detection using human eye blinking pattern.” IEEE Access, vol. 8, Apr. 2020, pp. 83144-83154. https://doi.org/10.1109/ACCESS.2020.2988660 Acessado 06 jul. 2022.
Kemp, Simon. “Digital 2021: Global Overview Report.” Data Reportal, We Are Social, Hootsuite, 27 Jan. 2021. KEPIOS, https://datareportal.com/reports/digital-2021-global-overview-report Acessado 06 jul. 2022.
Kohli, Aditi. Gupta, Abhinav. “Detecting deepfake, FaceSwap and Face2Face facial forgeries using frequency CNN.” Multimedia Tools and Applications, 18 Feb. 2021, pp. 1-18. Springer, https://doi.org/10.1007/s11042-020-10420-8 Acessado 06 jul. 2022.
Lemos, Daniela Lucas da Silva. Souza, Renato Rocha. “Knowledge organization systems for the representation of multimedia resources on the web: a comparative analysis.” Knowledge Organization, vol. 47, no. 4, 2020, pp. 300-319. Nomos e-Library, https://doi.org/10.5771/0943-7444-2020-4-300. Acessado 06 jul. 2022.
Li, Defang, et al. “A novel attribute-based generation architecture for facial image editing.” Multimedia Tools and Applications, vol. 80, no. 4, 1 Feb. 2021, pp. 4881-4902. https://doi.org/10.1007/s11042-020-09858-7. Acessado 06 jul. 2022.
Li, Haodong, et al. “Identification of deep network generated images using disparities in color components.” Signal Processing, vol. 174, Sep. 2020, pp. 1-12. Scopus (Elsevier), https://doi.org/10.1016/j.sigpro.2020.107616. Acessado 06 jul. 2022.
Li, Xiaodan, et al. “Sharp multiple instance learning for deepfake video detection.” Proceedings of the 28th ACM International Conference on Multimedia, 12 Oct. 2020. Association for Computing Machinery, http://doi.org/10.1145/3394171.3414034. Acessado 06 jul. 2022.
Maimone, Giovana Deliberali. “Informação e conhecimento: insumos para o trabalho organizativo em ciência da informação.” Informação & Informação, vol. 25, no. 3, 31 Oct. 2020, pp. 423-436. https://doi.org/10.5433/1981-8920.2020v25n3p423. Acessado 06 jul. 2022.
Maimone, Giovana Deliberali. Organização da informação e do conhecimento de documentos artísticos à luz da terminologia, 2013, University of São Paulo, DSc dissertation. https://doi.org/10.11606/T.27.2013.tde-23082013-112839. Acessado 06 jul. 2022.
Mazzocchi, Fulvio. “Knowledge organization system (KOS)”. Knowledge Organization, vol. 45, no. 1, 2018, pp. 54-78. Also available in ISKO Encyclopedia of Knowledge Organization, eds. Birger Hjørland and Claudio Gnoli, http://www.isko.org/cyclo/kos. Acessado 06 jul. 2022.
Mi, Zhongjie, et al. “GAN-Generated image detection with self-attention mechanism against GAN generator defect.” IEEE Journal of Selected Topics in Signal Processing, vol. 14, no. 5, 14 May 2020, pp. 969-981. https://doi.org/10.1109/JSTSP.2020.2994523. Acessado 06 jul. 2022.
Nadeem, Muhammad Shahroz, et al. “A Survey of deep learning solutions for multimedia visual content analysis.” IEEE Access, vol. 7, 24 Jun. 2019, pp. 84003-84019. https://doi.org/10.1109/ACCESS.2019.2924733. Acessado 06 jul. 2022.
Neves, João C., et al. “GANprintR: improved fakes and evaluation of the state of the art in face manipulation detection.” IEEE Journal of Selected Topics in Signal Processing, vol. 14, no. 5, 6 Jul. 2020, pp. 1038-1048. https://doi.org/10.1109/JSTSP.2020.3007250. Acessado 06 jul. 2022.
Nguyen, Xuan Hau, et al. “Learning spatio-temporal features to detect manipulated facial videos created by the deepfake techniques.” Forensic Science International: Digital Investigation, vol. 36, Mar. 2021, pp. 1-8. Scopus (Elsevier), https://doi.org/10.1016/j.fsidi.2021.301108. Acessado 06 jul. 2022.
Oxford Languages. Oxford Word of the Year 2016. Oxford University Press, 2016. https://languages.oup.com/word-of-the-year/2016/. Acessado 06 jul. 2022.
Qi, Hua, et al. “DeepRhythm: exposing deepfakes with attentional visual heartbeat rhythms. Proceedings of the 28th ACM International Conference on Multimedia.” Proceedings of the 28th ACM International Conference on Multimedia, 12 Oct. 2020. Association for Computing Machinery, https://doi.org/10.48550/arXiv.2006.07634. Acessado 06 jul. 2022.
Rocha, Carin Cunha. Pinto, Virgínia Bentes. David, Priscila Barros. “Arquitetura da informação: revisão integrativa em bases de dados de ciência da informação.” Informação & Informação, vol. 25, no. 2, Jul. 2020, pp. 49-73. http://dx.doi.org/10.5433/1981-8920.2020v25n2p49. Acessado 06 jul. 2022.
Souza, Ligiane A., et al. “The Role of Gazetteers in Geographic Knowledge Discovery on the Web.” Proceedings of the Third Latin American Web Congress, 2005, pp. 157-165.
Taheri, Shayan, et al. “Developing a robust defensive system against adversarial examples using generative adversarial networks.” Big Data and Cognitive Computing, vol. 4, no. 2, 22 May 2020, pp. 1-15. MDPI, https://doi.org/10.3390/bdcc4020011. Acessado 06 jul. 2022.
Tolosana, Ruben, et al. “Deepfakes and beyond: a survey of face manipulation and fake detection.” Information Fusion, vol. 64, Dec. 2020, pp. 131-148. Scopus (Elsevier), https://doi.org/10.1016/j.inffus.2020.06.014. Acessado 06 jul. 2022.
Vidotti, Silvana Aparecida Borsetti Gregorio, et al. “Web, Web Semântica e Web Pragmática: um posicionamento da Arquitetura da Informação.” Informação & Sociedade: Estudos, vol 29, no. 1, Jan./Mar. 2019, pp. 195-214. https://periodicos.ufpb.br/ojs/index.php/ies/article/view/44358. Acessado 06 jul. 2022.
Zhang, Kejun, et al. “No one can escape: a general approach to detect tampered and generated image.” IEEE Access, vol. 7, 23 Sep. 2019, pp. 129494-129503. https://doi.org/10.1109/ACCESS.2019.2939812. Acessado 06 jul. 2022.
Downloads
Published
Issue
Section
License
Copyright (c) 2022 Gabriel Meneguelli Soella, Giovana Deliberali Maimone
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
When submitting an article, the authors retain the copyright of the article, giving full rights to the Brazilian Journal of Information Science to publish the text.
The author(s) agree that the article, if editorially accepted for publication, shall be licensed under the Creative Commons Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) license (http://creativecommons.org/licenses/by-sa/4.0) Readers/users are free to: - Share — copy and redistribute the material in any medium or format - Adapt — remix, transform, and build upon the material for any purpose, even commercially. The licensor cannot revoke these freedoms as long as you follow the license terms. Under the following terms: - Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use. - ShareAlike — If you remix, transform, or build upon the material, you must distribute your contributions under the same license as the original. No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits. Notices: - You do not have to comply with the license for elements of the material in the public domain or where your use is permitted by an applicable exception or limitation. - No warranties are given. The license may not give you all of the permissions necessary for your intended use. For example, other rights such as publicity, privacy, or moral rights may limit how you use the material.
Creative Commons Attribution-ShareAlike 4.0 International License.
