Added Ifdef feature, chunk distribution statistics

Added output to file

Sampling output Thread

First stats test

Added Stats argument to enable output

Add command line option for kreon

Resolve CRTP specific function name

Testing Infrastructure for different databases

add path

Reactivated destructors, kreondb is destroyed to reduce CI space

Returning string_view in fs_data added dbbackend property

Updated Readme and MetatadaFactory

Adding extra options for kreondb, README+CHANGELOG updated

Update .gitlab-ci.yml

updating script test...

Updated dl_dep tests

Kreon test (for metadata) backend.

Add command line option for kreon

Resolve CRTP specific function name

Testing Infrastructure for different databases

add path

Reactivated destructors, kreondb is destroyed to reduce CI space

Returning string_view in fs_data added dbbackend property

Adding extra options for kreondb, README+CHANGELOG updated

updating script test...

Updated dl_dep tests

Remove Kreon - Add Parallax

Add Parallax

Add DockerFile

adding parallaxdb option

Docker update

Missing Parallax hpp

Removed Kreon from code, lib conflicts

Updated Parallax master

Updated DockerFile deps

Reformat

Changed Base

Added ps

Reduced Logging and added ps in docker

Add Path

increase testing timeout

Create options.yml automatically

Updated out tests

Marc Vef authored Jan 26, 2022 and Ramon Nou committed Feb 04, 2022

A subdirectory is no longer created by default. Therefore, a server restart uses same directory for both data and metadata. Note, that the rootdir can be cleaned with the -c argument. For multiple daemons on one machine, the new argument --rootdir-suffix can be used which creates a subdirectory within the rootdir with a user-defined name. This also allows restarting multiple daemons on one node without losing data.

Tunahan Kaya authored Dec 13, 2020 and Marc Vef committed Jul 07, 2021

--clean-rootdir

Ramon Nou authored Oct 01, 2020 and Ramon Nou committed Jun 16, 2021

Moved distributor instantation to RPC_DATA and daemon.cpp on the server side. Added interval_map to GuidedDistributor for better performance

Moving reads extended log to normal log module.

Update logging.hpp

Added GKFS prefix to CMake options

Catch2 Guided Distributor test

Added creation of /tmp/guided.txt in the test

updated README.MD and protected Distributor for duplicated inserts

Added metadata + data optimization with #

Removes 1 stat RPC per remove operation

Ramon Nou authored Nov 05, 2020 and Ramon Nou committed Dec 07, 2020

Added dirents_extended to get directory entries of a dir and a single server, added find proposal for io500, added tests

Client now reads host file to determine auto_sm and RPC protocol

Marc Vef authored Feb 25, 2020 and Alberto Miranda committed Jul 28, 2020

The `ChunkStorage` backend class on the daemon was throwing `system_errors` without being caught, crashing the server in the process. `ChunkStorage` now uses a designated error class for errors that might occur. In addition the dependency to Argobots was removed which was used to trigger `ABT_eventuals`, laying ground work for future non-Argobots IO implementations. Further, the whole class was refactored for consistency and failure resistance.

A new class `ChunkOperation` is introduced which wraps Argobots' IO task operations which allows the removal of IO queue specific code within RPC handlers, i.e., read and write handlers. The idea is to separate eventuals, tasks and their arguments from handler logic into a designated class. Therefore, an object of an inherited class of `ChunkOperation` is instantiated within the handlers that drives all IO tasks. The corresponding code was added to the read and write RPC handlers. Note, `ChunkOperation` is not thread-safe and is supposed to be called by a single thread.

In addition, truncate was reworked for error handling (it crashed the server on error) and that it uses the IO queue as well since truncate causes a write operation and should not overtake IO tasks in the queue.

The chunk stat rpc handler was refactored for error handling and to use error codes as well. 

Further minor changes:
- dead chunk stat code has been removed
- some namespaces were missing: `gkfs::rpc`
- more flexible handler cleanup and response code
- fixed a bug where the chunk dir wasn't removed when the metadata didn't exist on the same node