A system for the generation of in-car human body pose datasets

dc.contributor.authorSilva, João Pedro Borges Araújo Oliveirapor
dc.contributor.authorQueirós, Sandropor
dc.contributor.authorOliveira, Brunopor
dc.contributor.authorTorres, Helena Daniela Ribeiropor
dc.contributor.authorRodrigues, Nelsonpor
dc.contributor.authorCoelho, Victorpor
dc.contributor.authorPallauf, Johannespor
dc.contributor.authorBrito, José Henrique H.por
dc.contributor.authorMendes, José A.por
dc.contributor.authorFonseca, Jaime C.por
dc.date.accessioned2024-04-03T14:36:34Z
dc.date.available2024-04-03T14:36:34Z
dc.date.issued2021
dc.date.updated2024-04-03T12:14:58Z
dc.descriptionPublished online: 8 October 2020por
dc.description.abstractWith the advent of autonomous vehicles, detection of the occupants’ posture is crucial to tackle the needs of infotainment interaction or passive safety systems. Generative approaches have been recently proposed for human body pose in-car detection, but this type of approaches requires a large training dataset for a feasible accuracy. This requirement poses a difficulty, given the substantial time required to annotate such large amount of data. In the in-car scenario, this requirement risk increases even further, since a robust human body pose ground-truth system capable of working in it is needed but inexistent. Currently, the gold standard for human body pose capture is based on optical systems, requiring up to 39 visible markers for a plug-in gait model, which in this case are not feasible given the occlusions inside the car. Other solutions, such as inertial suits, also have limitations linked to magnetic sensitivity and global positioning drift. In this paper, a system for the generation of images for human body pose detection in an in-car environment is proposed. To this end, we propose to smartly combine inertial and optical systems to suppress their individual limitations: By combining the global positioning of 3 visible head markers provided by the optical system with the inertial suit’s relative human body pose, we obtain an occlusion-ready, drift-free full-body global positioning system. This system is then spatially and temporally calibrated with a time-of-flight sensor, automatically obtaining in-car image data with (multi-person) pose annotations. Besides quantifying the inertial suit inherent sensitivity and accuracy, the feasibility of the overall system for human body pose capture in the in-car scenario was demonstrated. Our results quantify the errors associated with the inertial suit, pinpoint some sources of the system’s uncertainty and propose how to minimize some of them. Finally, we demonstrate the feasibility of using system generated data (which was made publicly available), independently or mixed with two publicly available generic datasets (not in-car), to train 2 machine learning algorithms, demonstrating the improvement in their algorithmic accuracy for the in-car scenario.por
dc.description.sponsorshipThis work is supported by: European Structural and Investment Funds in the FEDER component, through the Operational Competitiveness and Internationalization Programme (COMPETE 2020) [Project n.º 002797; Funding Reference: POCI-01-0247-FEDER-002797].por
dc.distributioninternationalpor
dc.identifier.articlenumber4por
dc.identifier.citationBorges, J., Queirós, S., Oliveira, B. et al. A system for the generation of in-car human body pose datasets. Machine Vision and Applications 32, 4 (2021). https://doi.org/10.1007/s00138-020-01131-zpor
dc.identifier.doi10.1007/s00138-020-01131-zpor
dc.identifier.eissn1432-1769
dc.identifier.issn0932-8092
dc.identifier.urihttps://hdl.handle.net/1822/90539
dc.language.isoengpor
dc.peerreviewedyespor
dc.publisherSpringerpor
dc.relationPOCI-01-0247-FEDER-002797por
dc.relation.publisherversionhttps://link.springer.com/article/10.1007/s00138-020-01131-zpor
dc.rightsopenAccesspor
dc.subjectAutomotive applicationspor
dc.subjectDataset generationpor
dc.subjectHuman body pose estimationpor
dc.subjectSupervised learningpor
dc.subject.wosScience & Technology
dc.titleA system for the generation of in-car human body pose datasetspor
dc.typearticlepor
dspace.entity.typePublicationen
oaire.citationEndPage15por
oaire.citationIssue1por
oaire.citationStartPage1por
oaire.citationVolume32por
sdum.export.identifier16021
sdum.journalMachine Vision and Applicationspor

Ficheiros

Pacote original

A mostrar 1 - 1 de 1
A carregar...
Nome:
ASystemForTheGenerationOfIn-ca.pdf
Tamanho:
7.43 MB
Formato:
Adobe Portable Document Format