Ramon Nou authored 1 year ago and Marc Vef committed 1 year ago

Added NUM_REPL env variable. (0 no replicas)

NUM_REPL  num replicas  (Replicas < servers)

Remove and truncate

Metadata replication

Metadata replication - Reattempt on stat

minimal compilation issues (c++20), srand for repl

Bitset

Bit set proposal (WIP)

Read - Write with bitset (<1024 chunks)

Changed bitset to vector

Added get_fs_config reattempt

Some more resilience on create

Added Replica_Check on write (disabled)

Added helper vector-bitset functions

Release 0.9.2


See merge request !181

Resolve "Client logging: Add per process log option"

Closes #278

Closes #278

See merge request !179

create logs in separate files for each process of the client.

Resolve "Support mtime"

Closes #225

Closes #225

See merge request !178

Resolve "du doesn't show size"

Closes #261

Closes #261

See merge request !177

calculates blocksize by dividing size / 512 as it is legacy in the linux kernel, only if renaming is deactivated

Resolve "Add GKFS_ prefix to CMake options"

Closes #129

Closes #129

See merge request !173

Resolve "Remove Parallax Testing"

This MR updates testing for the new docker CI environment:
- Removes Parallax Testing to make faster tests (we will activate again if needed, or changes are applied)
- Adds cstdint for uint types (gcc 10..)
- Updates python sh library/package to a newer version. This solves and produces some changes.
- Solved a bug in sfind

Closes #268

Closes #268

See merge request !169

Change all env PosixPath to str

restore rocksdb

Removed extra debug line

Added max internal fds

Reduce OPEN_FDS

Missing option

Resolve "Support Spack and others"

### Usage information

Download Spack and setup environment:
```bash
git clone -c feature.manyFiles=true https://github.com/spack/spack.git
. spack/share/spack/setup-env.sh
```
Add GekkoFS Spack repository to Spack:
```bash
spack repo add gekkofs/scripts/spack
```
Check that Spack can find GekkoFS:
```
spack info gekkofs
```
Install GekkoFS (and run optional tests). Check `spack info gekkofs` for available option and versions:
```bash
spack install gekkofs
# for installing tests dependencies and running tests
spack install -v --test=root gekkofs +tests
```
Load GekkoFS into environment:
```
spack load gekkofs
```
If you want to use the latest developer branch of GekkoFS:
```
spack install gekkofs@latest
```
The default is using version 0.9.1 the last stable release.

### TODO

- [x] Base Spack functionality, versions, and configuration support
- [x] Documentation
- [x] Advanced functionality, more detailed configuration support, e.g., Parallax and Prometheus
- [x] More easy way to get path to client library
- [x] Add GekkoFS client wrapper for `LD_PRELOAD`
- [ ] Add final version to main Spack repository if possible. (Not possible right now as it not clear how 3rd party libraries should be treated.





















Closes #58

Closes #58

See merge request !137