Loading CHANGELOG.md +27 −15 Original line number Diff line number Diff line # Changelog All notable changes to GekkoFS project will be documented in this file. The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/), and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html). The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/), and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html). ## [Unreleased] - Parallax experimental integration Support for different databases backend New Docker Images and scripts (0.9.1) ([!110](https://storage.bsc.es/gitlab/hpc/gekkofs/-/merge_requests/110)). - Added `--clean-rootdir-finish` argument to remove rootdir/metadir at the end. ### New - Added new experimental metadata backend: Parallax ([!110](https://storage.bsc.es/gitlab/hpc/gekkofs/-/merge_requests/110)). - Added support to use multiple metadata backends. - Added `--clean-rootdir-finish` argument to remove rootdir/metadir at the end when the daemon finishes. ### Changed - `-c` argument has been moved to `--clean-rootdir-finish` and is now used to clean rootdir/metadir on daemon shutdown ([!110](https://storage.bsc.es/gitlab/hpc/gekkofs/-/merge_requests/110)). ### Removed ### Fixed ## [0.9.0] - 2022-02-22 ### New - GekkoFS now uses C++17 (!74). - Added a new `dirents_extended` function which can improve `find` operations. A corresponding example how to use this function can be found at - Added a new `dirents_extended` function which can improve `find` operations. A corresponding example how to use this function can be found at `examples/gfind/gfind.cpp` with a non-mpi version at `examples/gfind/sfind.cpp` ([!73](https://storage.bsc.es/gitlab/hpc/gekkofs/-/merge_requests/73)). - Code coverage reports for the source code are now generated and tracked Loading Loading @@ -82,8 +96,6 @@ Note that tests still require `Boost_preprocessor`. ([!116](https://storage.bsc.es/gitlab/hpc/gekkofs/-/merge_requests/116)). - Fixed an issue where `LOG_OUTPUT_TRUNC` did not work as expected ([!118](https://storage.bsc.es/gitlab/hpc/gekkofs/-/merge_requests/118)). - Added new metadata backend, kreon. ## [0.8.0] - 2020-09-15 ### New - Both client library and daemon have been extended to support the ofi+verbs Loading README.md +1 −1 Original line number Diff line number Diff line Loading @@ -110,7 +110,7 @@ Options: --dbbackend 'rocksdb' (default) or 'parallaxdb' can be specified as metadata backend, in that case a file in 'metadir' named rocksdbx is created. Parallaxdb support is experimental. --kreonsize 'parallaxdb' specific, size of the metadata file in GB. Minimal is 8 GB --parallax_size 'parallaxdb' specific, size of the metadata file in GB. Minimal is 8 GB (default 8, 8 GB) --version Print version and exit. ``` Loading docs/sphinx/users/running.md +1 −1 Original line number Diff line number Diff line Loading @@ -78,7 +78,7 @@ Further options are available --dbbackend 'rocksdb' (default) or 'parallaxdb' can be specified as metadata backend, in that case a file in 'metadir' named rocksdbx is created. Parallaxdb support is experimental. --kreonsize 'parallaxdb' specific, size of the metadata file in GB. Minimal is 8 GB --parallax_size 'parallaxdb' specific, size of the metadata file in GB. Minimal is 8 GB (default 8, 8 GB) --version Print version and exit. ```` Loading include/daemon/classes/fs_data.hpp +4 −5 Original line number Diff line number Diff line Loading @@ -71,10 +71,9 @@ private: // Database std::shared_ptr<gkfs::metadata::MetadataDB> mdb_; std::string dbbackend_; bool keep_rootdir_ = true; // Kreon unsigned long long size_md_ = 8589934592ull; // Parallax unsigned long long parallax_size_md_ = 8589934592ull; // Storage backend std::shared_ptr<gkfs::data::ChunkStorage> storage_; Loading Loading @@ -206,10 +205,10 @@ public: blocks_state(bool blocks_state); unsigned long long kreon_size_md() const; parallax_size_md() const; void kreon_size_md(unsigned int size_md); parallax_size_md(unsigned int size_md); }; } // namespace daemon Loading src/daemon/backend/metadata/parallax_backend.cpp +1 −3 Original line number Diff line number Diff line Loading @@ -90,7 +90,7 @@ ParallaxBackend::ParallaxBackend(const std::string& path) } if(size == 0) { size = GKFS_DATA->kreon_size_md(); size = GKFS_DATA->parallax_size_md(); lseek(fd, size - 1, SEEK_SET); std::string tmp = "x"; Loading Loading @@ -334,8 +334,6 @@ ParallaxBackend::decrease_size_impl(const std::string& key, size_t size) { std::vector<std::pair<std::string, bool>> ParallaxBackend::get_dirents_impl(const std::string& dir) const { auto root_path = dir; // lock_guard<recursive_mutex> lock_guard(kreon_mutex_); struct par_key K; str2par(root_path, K); Loading Loading
CHANGELOG.md +27 −15 Original line number Diff line number Diff line # Changelog All notable changes to GekkoFS project will be documented in this file. The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/), and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html). The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/), and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html). ## [Unreleased] - Parallax experimental integration Support for different databases backend New Docker Images and scripts (0.9.1) ([!110](https://storage.bsc.es/gitlab/hpc/gekkofs/-/merge_requests/110)). - Added `--clean-rootdir-finish` argument to remove rootdir/metadir at the end. ### New - Added new experimental metadata backend: Parallax ([!110](https://storage.bsc.es/gitlab/hpc/gekkofs/-/merge_requests/110)). - Added support to use multiple metadata backends. - Added `--clean-rootdir-finish` argument to remove rootdir/metadir at the end when the daemon finishes. ### Changed - `-c` argument has been moved to `--clean-rootdir-finish` and is now used to clean rootdir/metadir on daemon shutdown ([!110](https://storage.bsc.es/gitlab/hpc/gekkofs/-/merge_requests/110)). ### Removed ### Fixed ## [0.9.0] - 2022-02-22 ### New - GekkoFS now uses C++17 (!74). - Added a new `dirents_extended` function which can improve `find` operations. A corresponding example how to use this function can be found at - Added a new `dirents_extended` function which can improve `find` operations. A corresponding example how to use this function can be found at `examples/gfind/gfind.cpp` with a non-mpi version at `examples/gfind/sfind.cpp` ([!73](https://storage.bsc.es/gitlab/hpc/gekkofs/-/merge_requests/73)). - Code coverage reports for the source code are now generated and tracked Loading Loading @@ -82,8 +96,6 @@ Note that tests still require `Boost_preprocessor`. ([!116](https://storage.bsc.es/gitlab/hpc/gekkofs/-/merge_requests/116)). - Fixed an issue where `LOG_OUTPUT_TRUNC` did not work as expected ([!118](https://storage.bsc.es/gitlab/hpc/gekkofs/-/merge_requests/118)). - Added new metadata backend, kreon. ## [0.8.0] - 2020-09-15 ### New - Both client library and daemon have been extended to support the ofi+verbs Loading
README.md +1 −1 Original line number Diff line number Diff line Loading @@ -110,7 +110,7 @@ Options: --dbbackend 'rocksdb' (default) or 'parallaxdb' can be specified as metadata backend, in that case a file in 'metadir' named rocksdbx is created. Parallaxdb support is experimental. --kreonsize 'parallaxdb' specific, size of the metadata file in GB. Minimal is 8 GB --parallax_size 'parallaxdb' specific, size of the metadata file in GB. Minimal is 8 GB (default 8, 8 GB) --version Print version and exit. ``` Loading
docs/sphinx/users/running.md +1 −1 Original line number Diff line number Diff line Loading @@ -78,7 +78,7 @@ Further options are available --dbbackend 'rocksdb' (default) or 'parallaxdb' can be specified as metadata backend, in that case a file in 'metadir' named rocksdbx is created. Parallaxdb support is experimental. --kreonsize 'parallaxdb' specific, size of the metadata file in GB. Minimal is 8 GB --parallax_size 'parallaxdb' specific, size of the metadata file in GB. Minimal is 8 GB (default 8, 8 GB) --version Print version and exit. ```` Loading
include/daemon/classes/fs_data.hpp +4 −5 Original line number Diff line number Diff line Loading @@ -71,10 +71,9 @@ private: // Database std::shared_ptr<gkfs::metadata::MetadataDB> mdb_; std::string dbbackend_; bool keep_rootdir_ = true; // Kreon unsigned long long size_md_ = 8589934592ull; // Parallax unsigned long long parallax_size_md_ = 8589934592ull; // Storage backend std::shared_ptr<gkfs::data::ChunkStorage> storage_; Loading Loading @@ -206,10 +205,10 @@ public: blocks_state(bool blocks_state); unsigned long long kreon_size_md() const; parallax_size_md() const; void kreon_size_md(unsigned int size_md); parallax_size_md(unsigned int size_md); }; } // namespace daemon Loading
src/daemon/backend/metadata/parallax_backend.cpp +1 −3 Original line number Diff line number Diff line Loading @@ -90,7 +90,7 @@ ParallaxBackend::ParallaxBackend(const std::string& path) } if(size == 0) { size = GKFS_DATA->kreon_size_md(); size = GKFS_DATA->parallax_size_md(); lseek(fd, size - 1, SEEK_SET); std::string tmp = "x"; Loading Loading @@ -334,8 +334,6 @@ ParallaxBackend::decrease_size_impl(const std::string& key, size_t size) { std::vector<std::pair<std::string, bool>> ParallaxBackend::get_dirents_impl(const std::string& dir) const { auto root_path = dir; // lock_guard<recursive_mutex> lock_guard(kreon_mutex_); struct par_key K; str2par(root_path, K); Loading