Ensino de Engenharia de Dados nas universidades brasileiras e o mercado: estado atual e propostas de modernização

Abstract

The term Data Engineering (DE) has been frequently used in the literature to refer to the processes of acquiring, organizing, and preparing data for consumption in exploratory analyses, as input for systems and applications, or in other similar contexts. With the increasing volume of data today and its projected growth, DE technologies have advanced over the past decades and continue to evolve rapidly. At the same time, there is a perception that these technological advancements have not yet been fully absorbed by academia, which still focuses primarily on Relational Data Management in most curricula. Therefore, in this master’s research, we define an approach to investigate and mitigate this gap, consisting of two stages. In the first stage, we conducted an extensive survey on courses, bibliographies, and syllabi related to DE across 23 Brazilian universities and technology companies in the country. These surveys revealed that there is indeed a gap between DE education and market demands, with academic curricula often outdated regarding topics considered relevant to the contemporary industry. In the second stage of the study, we propose a modern alternative for teaching DE in universities, both in terms of content and teaching methods, drawing inspiration from contemporary experiences in teaching advanced DE topics.