Use INSTALL_PATH env variable to set rocksDB installtion path instead of using sed hack

Correctly set compilation flags in release mode

See merge request zdvresearch_bsc/adafs!46

Signed-off-by: Marc Vef <vef@uni-mainz.de>

CMAKE_CXX_FLAGS_RELEASE already defines "-DNDEBUG" and "-O3".
We set them just to be sure that even in older/newer version of Cmake
they are set correctly

dl script: exit on donwload task errors

See merge request zdvresearch_bsc/adafs!43

Signed-off-by: Marc Vef <vef@uni-mainz.de>

Log RocksDB open error details

See merge request zdvresearch_bsc/adafs!41

Signed-off-by: Marc Vef <vef@uni-mainz.de>

check dlopen errors

See merge request zdvresearch_bsc/adafs!40

Signed-off-by: Marc Vef <vef@uni-mainz.de>

Problem: If one of the donwload task fails the script do not stop and
the other task continue to donwload sources.

Solution: If one of the task fails, print an informative error message
and send a signal to the parent process that kills all the spawned tasks
and exits with error code.

Version bump dependencies. ADA-FS code modifications for Margo 0.3

See merge request zdvresearch_bsc/adafs!35

In case the glibc could not be loaded through dlopen print the relative
error and exit from the client

Fix linking of MPI libraries in ifs_test

See merge request zdvresearch_bsc/adafs!37

Signed-off-by: Marc Vef <vef@uni-mainz.de>

Tommaso Tocci authored Apr 11, 2018 and Marc Vef committed Apr 11, 2018

the MPI::MPI_CXX imported target only works for CMake > 3.9

In the case we are using a prior version we need to set include paths
and link libraries manually.

Also, startup and shutdown scripts now have a new argument
to decide on where the created pssh hostfile is stored.

It is only relevant for sparse files but the current implementation
has a too high overhead on a single node (~10%). We need to find
a better solution at a later point.

Random IO

See merge request zdvresearch_bsc/adafs!36

Signed-off-by: Marc Vef <vef@uni-mainz.de>

This is an optimization for mdtest which shows very slow performance
in removing files, getting worse with an increasing number of nodes.

cli: look for --help flag first

See merge request zdvresearch_bsc/adafs!34

Signed-off-by: Marc Vef <vef@uni-mainz.de>

Since the introduction of required parameters wasn't possible to show
the help message.
In fact the --help flag was checked after all other parameters.

mdtest summary calculation of multiple iterations might be flawed.
Also Daemon is restarted for each iteration.

Correctly set errno on open() and other open-related improovements

See merge request zdvresearch_bsc/adafs!33

Signed-off-by: Marc Vef <vef@uni-mainz.de>

Postpone the creation of the OpenFile object until we are sure that the
file actually exists and we have enough access rigths for it.

Problem:
In the case the path for which the check access is performed doesn't
exists the server will set `out.err` with the correct error number (ENOENT).
On client side the value of out.err is used as return value but the
errno variable is not set.

Resolve "Improve client RPC address lookups"

Closes #45

See merge request zdvresearch_bsc/adafs!31

Assert is put after a more detailed error message is written to the log.

Previously, host rpc addresses have been looked up lazily when a request
was done. This is not necessary as all hosts are looked up anyways
while the file system is running.

Now, all RPC addresses are looked up when the environment is initialized.
After that, the rpc_address map is only accessed read-only and does not
require a mutex anymore.

File mode

See merge request zdvresearch_bsc/adafs!32

Since POSIX.1-2001 the S_IFMT (0170000) bitmask of the file mode must
contain the file type.

At the moment we correctly support
 - [S_IFREG] regular file
 - [S_IFDIR] directory

Previously, clients would look for the daemon by name which was not robust.
If the daemon was started with valgrind for example, clients would not find
the daemon.

Similar to other applications a daemon now creates a pid file with
information about its pid and its started mountdir.

Proper errorhandling on server and client side was added.

Multiple daemons per node are explicitly not allowed for now!