A carregar...
Publicação
Big data framework implemented in cloud Azure
| Nome: | Descrição: | Tamanho: | Formato: | |
|---|---|---|---|---|
| 851.02 KB | Adobe PDF |
Autores
Orientador(es)
Resumo(s)
As the technology boom of the last decades has led to a much higher availability of data, companies can leverage it to make better business decisions. There are tools and techniques available to work with large amounts of data but this report focuses on studying one particular tool: Microsoft Azure. With it, a framework for processing big data was implemented with the objective to explore the tools of one of the most popular cloud services and develop the most effective architecture maintaining cost-effectiveness and the restraints of the project.
The digital ecosystem of Microsoft Azure is extremely extensive and complex, so only the relevant concepts and tools were explored, namely Databricks, Synapse Analytics, Data Factory, WebJobs and Storage. During this process a greater understanding of Microsoft Azure elements was gained, both for their applications and limits.
After the exploration phase, the Architecture defined was implemented that included the entire of the big data processing lifecycle and, following the entry of the framework into production, multiple possible improvements were found that can be either implemented or further researched.
Descrição
Mestrado Bolonha em Data Analytics for Business
Palavras-chave
Microsoft Azure Big Data Framework Data Lake
Contexto Educativo
Citação
Pêga, Sofia Alegre Fernandes (2023). “Big data framework implemented in cloud Azure”. Dissertação de Mestrado. Universidade de Lisboa. Instituto Superior de Economia e Gestão
Editora
Instituto Superior de Economia e Gestão