Efficient storage scheme for n-dimensional sparse array: GCRS/GCCS

Md Abu Hanif Shaikh, K. M.Azharul Hasan

Research output: Chapter in Book/Report/Conference proceedingConference paper

10 Citations (Scopus)

Abstract

Degree of data sparsity increases with the increase of number of dimensions in high performance scientific computing. Storing and applying operations on this highly sparse multidimensional data is still a challenge for data scientists. Experts suggest special storage scheme over sparse array. In traditional sparse array storage scheme, (n+l) one dimensional arrays are necessary to store n-dimensional array. In this paper, we propose 'Generalized Row/Column Storage (GCRS/GCCS)' scheme which requires three one dimensional arrays only for storing a n-dimensional array. The superiority of the GCRS/GCCS over traditional Compressed Row/Column Storage (CRS/CCS) is shown by both theoretical analysis and experimental results. In theoretical analysis, we derive equations for space and time complexity as well as the range of usability for GCRS/GCCS. It is shown that the GCRS/GCCS scheme yields to support minimum 50% data density where as the range of usability is inversely proportional with the number of dimensions for CRS/CCS scheme. The experimental result shows that the proposed GCRS/GCCS scheme outperforms the CRS/CCS scheme with respect to space complexity, time complexity and range of usability.

Original languageEnglish
Title of host publicationProceedings of the 2015 International Conference on High Performance Computing and Simulation, HPCS 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages137-142
Number of pages6
ISBN (Electronic)9781467378123
DOIs
Publication statusPublished - 2 Sep 2015
Event13th International Conference on High Performance Computing and Simulation, HPCS 2015 - Amsterdam, Netherlands
Duration: 20 Jul 201524 Jul 2015

Conference

Conference13th International Conference on High Performance Computing and Simulation, HPCS 2015
Country/TerritoryNetherlands
CityAmsterdam
Period20/07/1524/07/15

Keywords

  • Array Compression
  • Array operations
  • Array Storage
  • CCS
  • CRS
  • High Performance Computing
  • Multidimensional Array
  • Sparse Array

Fingerprint

Dive into the research topics of 'Efficient storage scheme for n-dimensional sparse array: GCRS/GCCS'. Together they form a unique fingerprint.

Cite this