Skip to content
GitLab
Projects Groups Topics Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
  • G gekkofs
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributor statistics
    • Graph
    • Compare revisions
  • Issues 85
    • Issues 85
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 10
    • Merge requests 10
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • hpc
  • gekkofs
  • Merge requests
  • !110

Resolve "Support other KV Databases"

  • Review changes

  • Download
  • Patches
  • Plain diff
Merged Ramon Nou requested to merge rnou/173-support-other-kv-databases into master Sep 20, 2021
  • Overview 56
  • Commits 17
  • Pipelines 100
  • Changes 84

Closes #173 (closed)

This MR adds support for different metadata backends. Actually, PARALLAX from FORTH is supported as experimental. PARALLAX needs a 8GB file (minimum size) to store metadata. It is created in the metadir directory as rocksdbx name. Inside the install script there is a commented line, to modify an internal parameter of PARALLAX increasing the key size drom 255 bytes to 4096 (Max PATH name in POSIX). However, PARALLAX is not (fully) tested with such values.

This backend should work in all the scenarios, but there are some issues that appear under high load mdtest.

This MR includes the optional compilation/dependencies of each of the backends. Testing is generated dynamically from conftest.template depending on the options selected.

This MR includes a new argument for the daemon to remove the rootdir/metadir files directories when the daemon is finished. This reduces the data from artifacts when running databases that uses a fixed size file. (i.e., Parallax)

Edited Mar 15, 2022 by Ramon Nou
Assignee
Assign to
Reviewers
Request review from
Time tracking
Source branch: rnou/173-support-other-kv-databases