Utilize este identificador para referenciar este registo:
https://hdl.handle.net/1822/46975
Registo completo
Campo DC | Valor | Idioma |
---|---|---|
dc.contributor.author | Costa, Eduarda Alexandra Pinto | por |
dc.contributor.author | Costa, Carlos Filipe Machado Silva | por |
dc.contributor.author | Santos, Maribel Yasmina | por |
dc.date.accessioned | 2017-11-02T15:14:20Z | - |
dc.date.issued | 2017-09 | - |
dc.identifier.citation | Costa, Eduarda, Carlos Costa and Maribel Yasmina Santos, “Efficient Big Data Modelling and Organization for Hadoop Hive-based Data Warehouses”, Proceedings of the European, Mediterranean and Middle Eastern Conference on Information Systems (EMCIS’2017), Coimbra, Portugal, 8-9 September, 2017. DOI: 10.1007/978-3-319-65930-5_1. | por |
dc.identifier.isbn | 978-3-319-65929-9 | - |
dc.identifier.issn | 1865-1348 | por |
dc.identifier.uri | https://hdl.handle.net/1822/46975 | - |
dc.description.abstract | The amount of data has increased exponentially as a consequence of the availability of new data sources and the advances in data collection and storage. This data explosion was accompanied by the popularization of the Big Data term, addressing large volumes of data, with several degrees of complexity, often without structure and organization, which cannot be processed or analyzed using traditional processes or tools. Moving towards Big Data Warehouses (BDWs) brings new problems and implies the adoption of new logical data models and tools to query them. Hive is a DW system for Big Data contexts that organizes the data into tables, partitions and buckets. Several studies have been conducted to understand ways of optimizing its performance in data storage and processing, but few of them explore whether the way data is structured has any influence on how quickly Hive responds to queries. This paper investigates the role of data organization and modelling in the processing times of BDWs implemented in Hive, benchmarking multidimensional star schemas and fully denormalized tables with different Scale Factors (SFs), and analyzing the impact of adequate data partitioning in these two data modelling strategies. | por |
dc.description.sponsorship | This work is supported by COMPETE: POCI-01-0145- FEDER- 007043 and FCT – Fundação para a Ciência e Tecnologia within the Project Scope: UID/CEC/00319/2013, and funded by the SusCity project, MITP-TB/CS/0026/2013, and by the Portugal Incentive System for Research and Technological Development, Project in co-promotion no. 002814/2015 (iFACTORY 2015– 2018). | por |
dc.language.iso | eng | por |
dc.publisher | Springer Verlag | por |
dc.relation | info:eu-repo/grantAgreement/FCT/5876/147280/PT | por |
dc.rights | restrictedAccess | por |
dc.rights.uri | http://creativecommons.org/licenses/by/4.0/ | por |
dc.subject | Big Data | por |
dc.subject | Data Warehousing | por |
dc.subject | Hive | por |
dc.subject | Modelling | por |
dc.subject | Partitioning | por |
dc.title | Efficient Big Data Modelling and Organization for Hadoop Hive-Based Data Warehouses | por |
dc.type | conferencePaper | por |
dc.peerreviewed | yes | por |
dc.relation.publisherversion | https://link.springer.com/chapter/10.1007/978-3-319-65930-5_1 | por |
oaire.citationStartPage | 3 | por |
oaire.citationEndPage | 16 | por |
oaire.citationConferencePlace | Coimbra, Portugal | por |
oaire.citationVolume | 299 | por |
dc.identifier.doi | 10.1007/978-3-319-65930-5_1 | por |
dc.identifier.eisbn | 978-3-319-65930-5 | - |
dc.subject.fos | Engenharia e Tecnologia::Outras Engenharias e Tecnologias | por |
dc.description.publicationversion | info:eu-repo/semantics/publishedVersion | por |
dc.subject.wos | Science & Technology | por |
sdum.journal | Lecture Notes in Business Information Processing | por |
sdum.conferencePublication | European, Mediterranean and Middle Eastern Conference on Information Systems (EMCIS’2017) | por |
sdum.bookTitle | Information Systems. EMCIS 2017. Lecture Notes in Business Information Processing | por |
Aparece nas coleções: |
Ficheiros deste registo:
Ficheiro | Descrição | Tamanho | Formato | |
---|---|---|---|---|
EMCIS2017_EC_CC_MYS.pdf Acesso restrito! | 949,59 kB | Adobe PDF | Ver/Abrir |
Este trabalho está licenciado sob uma Licença Creative Commons