A comprehensive study of geochemical data storage performance based on different management methods

Yinyi Cheng, Kefa Zhou, Jinlin Wang, Philippe De Maeyer, Tim Van de Voorde, Jining Yan, Shichao Cui

Research output: Contribution to journalArticle

19 Downloads (Pure)

Abstract

The spatial calculation of vector data is crucial for geochemical analysis in geological big data. However, large volumes of geochemical data make for inefficient management. Therefore, this study proposed a shapefile storage method based on MongoDB in GeoJSON form (SSMG) and a shapefile storage method based on PostgreSQL with open location code (OLC) geocoding (SSPOG) to solve the problem of low efficiency of electronic form management. The SSMG method consists of a JSONification tier and a cloud storage tier, while the SSPOG method consists of a geocoding tier, an extension tier, and a storage tier. Using MongoDB and PostgreSQL as databases, this study achieved two different types of high-throughput and high-efficiency methods for geochemical data storage and retrieval. Xinjiang, the largest province in China, was selected as the study area in which to test the proposed methods. Using geochemical data from shapefile as a data source, several experiments were performed to improve geochemical data storage efficiency and achieve efficient retrieval. The SSMG and SSPOG methods can be applied to improve geochemical data storage using different architectures, so as to achieve management of geochemical data organization in an efficient way, through time consumed and data compression ratio (DCR), in order to better support geological big data. The purpose of this study was to find ways to build a storage method that can improve the speed of geochemical data insertion and retrieval by using excellent big data technology to help us efficiently solve problem of geochemical data preprocessing and provide support for geochemical analysis.

Original languageEnglish
Article number3208
JournalRemote Sensing
Volume13
Issue number16
DOIs
Publication statusPublished - 2 Aug 2021

Keywords

  • Data storage
  • Database
  • Geochemical data
  • Retrieval

Fingerprint

Dive into the research topics of 'A comprehensive study of geochemical data storage performance based on different management methods'. Together they form a unique fingerprint.

Cite this