Utilize este identificador para referenciar este registo:
https://hdl.handle.net/1822/55212
Título: | Partitioning and bucketing in hive-based big data warehouses |
Autor(es): | Costa, Eduarda Costa, Carlos A. Santos, Maribel Yasmina |
Palavras-chave: | Big data Big data warehouse Buckets Hive Partitions |
Data: | 2018 |
Editora: | Springer Verlag |
Revista: | Advances in Intelligent Systems and Computing |
Resumo(s): | Hive is a tool that allows the implementation of Data Warehouses for Big Data contexts, organizing data into tables, partitions and buckets. Some studies have been conducted to understand ways of optimizing the performance of data storage and processing techniques/technologies for Big Data Warehouses. However, few of these studies explore whether the way data is structured has any influence on how Hive responds to queries. Thus, this work investigates the impact of creating partitions and buckets in the processing times of Hive-based Big Data Warehouses. The results obtained with the application of different modelling and organization strategies in Hive reinforces the advantages associated to the implementation of Big Data Warehouses based on denormalized models and, also, the potential benefit of adequate partitioning that, once aligned with the filters frequently applied on data, can significantly decrease the processing times. In contrast, the use of bucketing techniques has no evidence of significant advantages. |
Tipo: | Artigo em ata de conferência |
URI: | https://hdl.handle.net/1822/55212 |
ISBN: | 9783319777115 |
DOI: | 10.1007/978-3-319-77712-2_72 |
ISSN: | 2194-5357 |
Arbitragem científica: | yes |
Acesso: | Acesso restrito UMinho |
Aparece nas coleções: |
Ficheiros deste registo:
Ficheiro | Descrição | Tamanho | Formato | |
---|---|---|---|---|
Costa et al. - 2018 - Partitioning and Bucketing in Hive-Based Big Data .pdf Acesso restrito! | 484,15 kB | Adobe PDF | Ver/Abrir |