- Oct 09, 2023
-
-
Alberto Miranda authored
Resolve "Add a CLI tool for requesting data transfers." This MR adds the `ccp` tool to Cargo so that data transfers can be started from the command line. The tool supports the following arguments: ```console $ ccp -h Cargo parallel copy tool Usage: ccp [OPTIONS] Options: -h,--help Print this help message and exit -s,--server ADDRESS Address of the Cargo server (can also be provided via the CCP_SERVER environment variable). -i,--input SRC... Input dataset(s) -o,--output DST... Output dataset(s) --if FLAGS Flags for input datasets. Accepted values - posix: read data using POSIX (default) - mpio: read data using MPI-IO --of FLAGS Flags for output datasets. Accepted values - posix: write data using POSIX (default) - mpio: write data using MPI-IO ``` Once a Cargo server is up and running, `ccp` can be used as follows: ```console $ srun -N4 cargo -l ofi+tcp://192.18.0.10:62000 -o cargo.log [...] $ ccp -s ofi+tcp://192.18.0.10:62000 -i input0.dat input1.dat -o output0.dat output1.dat ``` Modes of operation that control how transfers should be executed can be selected through the the `--if` and `--of` options. For now, `posix` and `mpio` modes are supported. Note however that not all combinations are supported yet, and that performance will depend on whether the underlying file system supports parallel I/O through MPI-IO. Closes #19 See merge request !13
-
Alberto Miranda authored
-
- Oct 06, 2023
-
-
Alberto Miranda authored
-
Alberto Miranda authored
-
- Oct 05, 2023
-
-
Alberto Miranda authored
Resolve "Race condition when shutting down" Closes #17 See merge request !12
-
Alberto Miranda authored
-
- Oct 02, 2023
-
-
Alberto Miranda authored
Resolve "Update Spack recipe to v0.2.0" Closes #16 See merge request !11
-
Alberto Miranda authored
-
Alberto Miranda authored
-
Alberto Miranda authored
Resolve "Release Cargo 0.2.0" Closes #15 See merge request !10
-
Alberto Miranda authored
-
Alberto Miranda authored
-
Alberto Miranda authored
-
- Sep 29, 2023
-
-
Alberto Miranda authored
Resolve "`std::filesystem::filesystem_error`s not reported in log" Closes #13 See merge request !9
-
Alberto Miranda authored
-
Alberto Miranda authored
1. Catch `std::system_error`s, log them, and report them as Cargo system errors. 2. Catch and report `std:::exception`s, log them, and report them as Cargo `error_code::other`
-
Alberto Miranda authored
-
Alberto Miranda authored
Resolve "Automatically run tests in pipelines" This MR enables automatic testing using `ctest`, and also updates the CI pipelines so that they run `build` and `test` jobs exercising the code. We also add a `Dockerfile` that builds an appropriate CI environment to build, test, and run Cargo. Closes #6 Closes #6 See merge request !8
-
Alberto Miranda authored
-
Alberto Miranda authored
Add job for integration tests
-
Alberto Miranda authored
-
Alberto Miranda authored
-
Alberto Miranda authored
-
Alberto Miranda authored
Add `build` stages
-
Alberto Miranda authored
-
Alberto Miranda authored
- `cargo_ping`: Send a ping to a Cargo server - `cargo_shutdown`: Send a shutdwon request to a Cargo server
-
Alberto Miranda authored
-
Alberto Miranda authored
-
- Sep 28, 2023
-
-
Alberto Miranda authored
Merge branch 'amiranda/10-support-waiting-for-a-transfer-request-to-complete-via-std-future' into 'main' Resolve "Support waiting for a transfer request to complete" Closes #10 See merge request !6
-
Alberto Miranda authored
-
Alberto Miranda authored
-
Alberto Miranda authored
-
Alberto Miranda authored
-
Alberto Miranda authored
- Add `transfer_state` enum with appropriate values for a transfer current status. - Add `transfer_status` class with functions `state()`, `done()`, `failed()` and `error()` to retrieve a transfer's current status and its associated error condition in case of failure. - Extend the `transfer` class with functions `wait()`, and `wait_for()`, to wait for the completion of a transfer request. - Add new error codes: `no_such_transfer` and `transfer_in_progress`. - Add new formatters: `transfer_state` and `std::optional<T>`. - Add new API function: `transfer_dataset` as a convenience function to request the transfer of a single dataset.
-
Alberto Miranda authored
-
Alberto Miranda authored
-
Alberto Miranda authored
-
Alberto Miranda authored
-
Alberto Miranda authored
-
Alberto Miranda authored
-