When rocksdb is build with jemalloc linking with adafs was failing

Preload: Better naming in IO process + chnk_end target fix

See merge request zdvresearch_bsc/adafs!25

Resolve "Remove all chunks when a file is removed"

Closes #34

See merge request zdvresearch_bsc/adafs!22

bugfix: dl_script with non-existing output path

See merge request zdvresearch_bsc/adafs!23

Client io cleanup

See merge request zdvresearch_bsc/adafs!24

Instead use margo_iforward. Also only two bulk_handles are now used:
1 for margo_ipc and one for margo_rpc RPC requests.

The download script do not work if the specified output path
contains more then 1 non-existing folder.
This is due to the -f flag used in the readlink command.
We now use the less strict -m one.

Resolve "IO exceeding segment count"

Closes #32

See merge request zdvresearch_bsc/adafs!13

The LRU map caused multiple issues with memory mappings and caused
severe errors and hanging situations. It has been replaced with a
std::map.

An Argobots mutex was added for rpc address lookups as many threads
might insert and lookup this map in parallel. This caused bulk_transfer
seqfauls as well as other file system crashes.

Cleanup of file system logging.

Before data was pulled first then written or read first and then pushed back

Only use 1 segment now but with multiple transfers

ensure folder creation on download script

See merge request zdvresearch_bsc/adafs!20

Source folder was removed if existed before but never recreated

test: add simple Write/Read test

See merge request zdvresearch_bsc/adafs!19

This is a very simple test that just write a file and read it, checking
for content match.

- Relax cmake version requirment
- Specify project language
- Force CXX standard requirments
- Compile MPI test only if suitable MPI implementation have found to be
  installed locally

Introduce docker images

See merge request zdvresearch_bsc/adafs!17

Tommaso Tocci authored Feb 22, 2018 and Marc Vef committed Mar 13, 2018

The new docker folder will host all the docker image files.
At the moment there is only one image file that allows to build a container based on CentOS 7 that provides a complete build environment for ADAFS. It is bundled with all the required dependencies, both from system repository and the ones that need to be compiled from source. It also provide a suitable compiler (gcc 7.2.1) for later use.

This container can be use as developing environment as well as the base for other images. For instance we can use it to build a container that provide the ADAFS daemon.

Speedup dependencies download and compilation

See merge request zdvresearch_bsc/adafs!16

Since the download of sources are performed in parallel, we cannot use
anymore a single log file.

The output of the download commands has been reduced to errrors only and
it will be outputted directly on stderr. Thus the log file stuff have been
completely removed.

Moreover the clonedeps function now takes the REPO as second parameter
and additional (non mandatory) git flags as fourth parameter.

Additional fixes have been introduced to run commands in script mode
(-q, -f, ...)

For dependencies in which a specific tags is specified we can download
the code snapshot instead of cloning the whole repo.

Perform all the download and git clone action in parallel using several
processes.

Due to the new parallel use of the clonedeps and wgetdeps functions,
some adjustment to printed message has been made. Now the function write
on stdout only once when they complete.

cmake: find packages (Boost & pthread)

See merge request zdvresearch_bsc/adafs!14

Use cmake in order to properly check and use both the Boost library and
the pthread one.

IOR support and I/O threading improvements

See merge request zdvresearch_bsc/adafs!12

We need to be explicit about I/O as it cannot be simply repeated. A response
from the daemon will come eventually, either success or failure.