Fix misaligned operations

See merge request zdvresearch_bsc/adafs!28

target was the index of the cycle and target[target] was the actual
identifier of the target. In some part of the code target was considered
as the identifier directly.

Now the index of the cycle is i and target is the actual identifier of
the target.

The calculus (on clients) about the last chunk involved into a
write/read operation was bugged.

A new blocks_calc_util library has been introduced in order to make
easier to perform this kind of calculus.

startup script: do not check for local daemon

See merge request zdvresearch_bsc/adafs!30

In the case the host running the startup script is not one of the node
that will run adafs it does not make sense to check for the binary of
the daemon locally.

Preload: Better naming in IO process + chnk_end target fix

See merge request zdvresearch_bsc/adafs!25

Resolve "Remove all chunks when a file is removed"

Closes #34

See merge request zdvresearch_bsc/adafs!22

bugfix: dl_script with non-existing output path

See merge request zdvresearch_bsc/adafs!23

Client io cleanup

See merge request zdvresearch_bsc/adafs!24

Instead use margo_iforward. Also only two bulk_handles are now used:
1 for margo_ipc and one for margo_rpc RPC requests.

The download script do not work if the specified output path
contains more then 1 non-existing folder.
This is due to the -f flag used in the readlink command.
We now use the less strict -m one.

Resolve "IO exceeding segment count"

Closes #32

See merge request zdvresearch_bsc/adafs!13

The LRU map caused multiple issues with memory mappings and caused
severe errors and hanging situations. It has been replaced with a
std::map.

An Argobots mutex was added for rpc address lookups as many threads
might insert and lookup this map in parallel. This caused bulk_transfer
seqfauls as well as other file system crashes.

Cleanup of file system logging.

Before data was pulled first then written or read first and then pushed back

Only use 1 segment now but with multiple transfers

ensure folder creation on download script

See merge request zdvresearch_bsc/adafs!20

Source folder was removed if existed before but never recreated

test: add simple Write/Read test

See merge request zdvresearch_bsc/adafs!19

This is a very simple test that just write a file and read it, checking
for content match.

- Relax cmake version requirment
- Specify project language
- Force CXX standard requirments
- Compile MPI test only if suitable MPI implementation have found to be
  installed locally

Introduce docker images

See merge request zdvresearch_bsc/adafs!17

Tommaso Tocci authored Feb 22, 2018 and Marc Vef committed Mar 13, 2018

The new docker folder will host all the docker image files.
At the moment there is only one image file that allows to build a container based on CentOS 7 that provides a complete build environment for ADAFS. It is bundled with all the required dependencies, both from system repository and the ones that need to be compiled from source. It also provide a suitable compiler (gcc 7.2.1) for later use.

This container can be use as developing environment as well as the base for other images. For instance we can use it to build a container that provide the ADAFS daemon.

Speedup dependencies download and compilation

See merge request zdvresearch_bsc/adafs!16

Since the download of sources are performed in parallel, we cannot use
anymore a single log file.

The output of the download commands has been reduced to errrors only and
it will be outputted directly on stderr. Thus the log file stuff have been
completely removed.

Moreover the clonedeps function now takes the REPO as second parameter
and additional (non mandatory) git flags as fourth parameter.

Additional fixes have been introduced to run commands in script mode
(-q, -f, ...)