gekkofs merge requestshttps://storage.bsc.es/gitlab/hpc/gekkofs/-/merge_requests2024-03-27T21:33:24+01:00https://storage.bsc.es/gitlab/hpc/gekkofs/-/merge_requests/176Draft: Resolve "Client: Support MessagePack for process bandwidth monitoring"2024-03-27T21:33:24+01:00Marc VefDraft: Resolve "Client: Support MessagePack for process bandwidth monitoring"Closes #271Closes #271v0.9.3Marc VefMarc Vefhttps://storage.bsc.es/gitlab/hpc/gekkofs/-/merge_requests/175Draft: Resolve "Alternative to the hostsfile"2023-12-01T17:01:07+01:00Julius AthenstaedtDraft: Resolve "Alternative to the hostsfile"Closes #202Closes #202v1.0.0Julius AthenstaedtJulius Athenstaedthttps://storage.bsc.es/gitlab/hpc/gekkofs/-/merge_requests/168Data Erasure codes - Resilience2023-10-03T08:26:57+02:00Ramon NouData Erasure codes - ResilienceErasure codes enables the capability to recover data with less space that with replication. The implementation uses Jerasure library (same as CEPH) and uses the `NUM_REPL` environment variable to choose how many servers are used to store...Erasure codes enables the capability to recover data with less space that with replication. The implementation uses Jerasure library (same as CEPH) and uses the `NUM_REPL` environment variable to choose how many servers are used to store ECs.
Activation of the code is done using CMAKE `GKFS_ENABLE_EC`.
ECs are only stored/generated with a complete chunk line (num_servers - num_repl).
Additionaly the user can enable the `-DGKFS_ENABLE_READ_ERRORS` to inject a
50% of read errors into the workflow.futureRamon NouRamon Nouhttps://storage.bsc.es/gitlab/hpc/gekkofs/-/merge_requests/152Draft: Resolve "UCX support"2022-08-31T19:19:38+02:00Marc VefDraft: Resolve "UCX support"Closes #207Closes #207v0.9.2Marc VefMarc Vefhttps://storage.bsc.es/gitlab/hpc/gekkofs/-/merge_requests/93Draft: Resolve "Add dedicated storage backend for NVM"2021-12-21T16:24:00+01:00Alberto MirandaDraft: Resolve "Add dedicated storage backend for NVM"
- [x] Add PMDK dependency to CMake
- [x] Add PMDK dependencies to docker images
- [x] Update `dl_dep.sh` and `compile_dep.sh` scripts with PMDK library
- [ ] Enable runtime configuration of data backends
- [ ] Design common interface fo...
- [x] Add PMDK dependency to CMake
- [x] Add PMDK dependencies to docker images
- [x] Update `dl_dep.sh` and `compile_dep.sh` scripts with PMDK library
- [ ] Enable runtime configuration of data backends
- [ ] Design common interface for data backends
- [ ] Implement PMDK backend
- [x] Add abstraction to manage PMDK pools
- [ ] Implement `pmdk::ChunkStorage` class
- [ ] Enable integration tests to run also for PMDK backends
Closes #124v1.0.0Alberto MirandaAlberto Mirandahttps://storage.bsc.es/gitlab/hpc/gekkofs/-/merge_requests/89Draft: Resolve "New feature: data staging API"2021-06-21T13:51:50+02:00Alberto MirandaDraft: Resolve "New feature: data staging API"Closes #148Closes #148futureAlberto MirandaAlberto Miranda