MaskLayer: Enabling scalable deep learning solutions by training embedded feature sets

Onderzoeksoutput: Articlepeer review

2 Citaten (Scopus)

Samenvatting

Deep learning-based methods have shown to achieve excellent results in a variety of domains, however, some important assets are absent. Quality scalability is one of them. In this work, we introduce a novel and generic neural network layer, named MaskLayer. It can be integrated in any feedforward network, allowing quality scalability by design by creating embedded feature sets. These are obtained by imposing a specific structure of the feature vector during training. To further improve the performance, a masked optimizer and a balancing gradient rescaling approach are proposed. Our experiments show that the cost of introducing scalability using MaskLayer remains limited. In order to prove its generality and applicability, we integrated the proposed techniques in existing, non-scalable networks for point cloud compression and semantic hashing with excellent results. To the best of our knowledge, this is the first work presenting a generic solution able to achieve quality scalable results within the deep learning framework.
Originele taal-2English
Pagina's (van-tot)43-53
Aantal pagina's11
TijdschriftNeural Networks
Volume137
DOI's
StatusPublished - mei 2021

Bibliografische nota

Funding Information:
The first author is a FWO-SB PhD fellow funded by Research Foundation — Flanders (FWO), Belgium , project number 1S89420N .

Publisher Copyright:
© 2021 Elsevier Ltd

Copyright:
Copyright 2021 Elsevier B.V., All rights reserved.

Vingerafdruk

Duik in de onderzoeksthema's van 'MaskLayer: Enabling scalable deep learning solutions by training embedded feature sets'. Samen vormen ze een unieke vingerafdruk.

Citeer dit