Writes with chunksize < 64 Kb fail
Copying files to GekkoFS (1 single process, 10 nodes, 32K CHUNKSIZE)
Client log
[2020-03-25 15:47:46.255193 CET] [363855] [debug] <forward_write():60> path: "/alya-long.err", append_flag:false, in_offset:0, offset:0, write_size: 9897, updated_metadentry_size:9897, chnk_start:0, chnk_end:0,
[2020-03-25 15:47:46.255260 CET] [363855] [hermes] [debug] <create_mercury_bulk_handle():208> Creating Mercury bulk handle
[2020-03-25 15:47:46.255374 CET] [363855] [debug] <forward_write():127> Sending RPC ...
[2020-03-25 15:47:46.255551 CET] [363855] [hermes] [debug] <post_to_mercury():309> Sending request
[2020-03-25 15:47:46.255588 CET] [363855] [hermes] [debug] <create_mercury_handle():174> Creating Mercury handle
[2020-03-25 15:47:46.255636 CET] [363857] [syscall] [ah] sendto(sockfd=50002, dest_addr=0xebe114, len=0xec, addr=0x4000, addrlen=0x0) = ?
[2020-03-25 15:47:46.255650 CET] [363855] [hermes] [debug] <get():111> Getting RPC results (pending: 0)
[2020-03-25 15:47:46.255684 CET] [363857] [syscall] [ak] sendto(sockfd=50002, dest_addr=0xebe114, len=0xec, addr=0x4000, addrlen=0x0) = 236
[2020-03-25 15:47:46.255693 CET] [363855] [debug] <forward_write():154> host: 2, path: "/alya-long.err", chunks: 1, size: 31741, offset: 0
[2020-03-25 15:47:46.255730 CET] [363857] [syscall] [ah] write(fd=50014, buf=0x7f27c940cb1f, count=0x1) = ?
[2020-03-25 15:47:46.255745 CET] [363855] [hermes] [debug] <get():111> Getting RPC results (pending: 1)
[2020-03-25 15:47:46.255765 CET] [363857] [debug] <hook_write():182> hook_write() called with fd: 50014, buf: 0x7f27c940cb1f, count 1
[2020-03-25 15:47:46.255783 CET] [363855] [syscall] [ih] futex(uaddr=0xe9f140, op=0x0, val=0x80000000, utime=0x7ffe5778fd20, uaddr2=0x438407fe, val3=0xef4051) = ?
[2020-03-25 15:47:46.255801 CET] [363857] [syscall] [ah] write(fd=50014, buf=0x7f27c940cb1f, count=0x1) = 1
[2020-03-25 15:47:46.255851 CET] [363860] [syscall] [ah] read(fd=50013, buf=0x7f2649409258, count=0x1) = ?
[2020-03-25 15:47:46.255958 CET] [363860] [debug] <hook_read():159> hook_read() called with fd: 50013, buf: 0x7f2649409258 count: 1
[2020-03-25 15:47:46.256002 CET] [363857] [syscall] [ah] read(fd=50004, buf=0x7f27c940cd90, count=0x1) = ?
[2020-03-25 15:47:46.256008 CET] [363860] [syscall] [ah] read(fd=50013, buf=0x7f2649409258, count=0x1) = 1
[2020-03-25 15:47:46.256038 CET] [363857] [debug] <hook_read():159> hook_read() called with fd: 50004, buf: 0x7f27c940cd90 count: 1
[2020-03-25 15:47:46.256073 CET] [363857] [syscall] [ah] read(fd=50004, buf=0x7f27c940cd90, count=0x1) = 1
[2020-03-25 15:47:46.262382 CET] [363857] [syscall] [ah] recvfrom(sockfd=50002, src_addr=0x7f284be18680, len=0x18, addr=0x2, addrlen=NULL) = ?
[2020-03-25 15:47:46.262423 CET] [363857] [syscall] [ak] recvfrom(sockfd=50002, src_addr=0x7f284be18680, len=0x18, addr=0x2, addrlen=NULL) = 24
[2020-03-25 15:47:46.262464 CET] [363857] [syscall] [ah] recvfrom(sockfd=50002, src_addr=0x7f284be18680, len=0x18, addr=0x2, addrlen=NULL) = ?
[2020-03-25 15:47:46.262502 CET] [363857] [syscall] [ak] recvfrom(sockfd=50002, src_addr=0x7f284be18680, len=0x18, addr=0x2, addrlen=NULL) = 24
[2020-03-25 15:47:46.262542 CET] [363857] [syscall] [ah] recvfrom(sockfd=50002, src_addr=0xebe0e0, len=0x34, addr=NULL, addrlen=NULL) = ?
[2020-03-25 15:47:46.262579 CET] [363857] [syscall] [ak] recvfrom(sockfd=50002, src_addr=0xebe0e0, len=0x34, addr=NULL, addrlen=NULL) = 52
[2020-03-25 15:47:46.262618 CET] [363857] [syscall] [ah] write(fd=50014, buf=0x7f27c940cbff, count=0x1) = ?
[2020-03-25 15:47:46.262651 CET] [363857] [debug] <hook_write():182> hook_write() called with fd: 50014, buf: 0x7f27c940cbff, count 1
[2020-03-25 15:47:46.262686 CET] [363857] [syscall] [ah] write(fd=50014, buf=0x7f27c940cbff, count=0x1) = 1
[2020-03-25 15:47:46.262736 CET] [363860] [syscall] [ah] read(fd=50013, buf=0x7f2649409258, count=0x1) = ?
[2020-03-25 15:47:46.262825 CET] [363860] [debug] <hook_read():159> hook_read() called with fd: 50013, buf: 0x7f2649409258 count: 1
[2020-03-25 15:47:46.262875 CET] [363860] [syscall] [ah] read(fd=50013, buf=0x7f2649409258, count=0x1) = 1
[2020-03-25 15:47:46.262943 CET] [363860] [syscall] [ah] futex(uaddr=0xe9f148, op=0x81, val=0x7fffffff, utime=NULL, uaddr2=0x1, val3=0xca) = ?
[2020-03-25 15:47:46.262990 CET] [363860] [syscall] [ak] futex(uaddr=0xe9f148, op=0x81, val=0x7fffffff, utime=NULL, uaddr2=0x1, val3=0xca) = 0
[2020-03-25 15:47:46.263034 CET] [363860] [syscall] [ah] futex(uaddr=0xe9f140, op=0x1, val=0x7fffffff, utime=0x1, uaddr2=0xca, val3=0x7f284b8ba2fb) = ?
[2020-03-25 15:47:46.263078 CET] [363860] [syscall] [ak] futex(uaddr=0xe9f140, op=0x1, val=0x7fffffff, utime=0x1, uaddr2=0xca, val3=0x7f284b8ba2fb) = 1
[2020-03-25 15:47:46.263141 CET] [363855] [syscall] [ik] futex(uaddr=0xe9f140, op=0x0, val=0x80000000, utime=0x7ffe5778fd20, uaddr2=0x438407fe, val3=0xef4051) = 0
[2020-03-25 15:47:46.263372 CET] [363855] [error] Daemon reported error: 16
[2020-03-25 15:47:46.263422 CET] [363855] [hermes] [debug] <get():111> Getting RPC results (pending: 1)
[2020-03-25 15:47:46.263486 CET] [363855] [warning] gkfs::rpc::forward_write() failed with ret -1
[2020-03-25 15:47:46.263523 CET] [363855] [syscall] [ah] write(fd=10001, buf=0xf17000, count=0x26a9) = -1 EBUSY (Device or resource busy)
Server Log:
[20-03-25 15:47:46.069119] 266839 [I][main] rpc_srv_write() path: '/Alya.x' chunk_start '0' chunk_end '254' chunk_n '30' total_chunk_size '1310700' bulk_size: '8388608' offset: '0'
[20-03-25 15:47:46.070954] 363770 [I][main] rpc_srv_write() path: '/Alya.x' chunk_start '0' chunk_end '254' chunk_n '17' total_chunk_size '721012' bulk_size: '8388608' offset: '0'
[20-03-25 15:47:46.071256] 93333 [I][main] rpc_srv_write() path: '/Alya.x' chunk_start '0' chunk_end '254' chunk_n '34' total_chunk_size '1485460' bulk_size: '8388608' offset: '0'
[20-03-25 15:47:46.073400] 8303 [I][main] rpc_srv_write() path: '/Alya.x' chunk_start '0' chunk_end '254' chunk_n '26' total_chunk_size '1135940' bulk_size: '8388608' offset: '0'
[20-03-25 15:47:46.073236] 183290 [I][main] rpc_srv_write() path: '/Alya.x' chunk_start '0' chunk_end '254' chunk_n '23' total_chunk_size '1004870' bulk_size: '8388608' offset: '0'
[20-03-25 15:47:46.079628] 232849 [I][main] rpc_srv_write() path: '/Alya.x' chunk_start '0' chunk_end '254' chunk_n '25' total_chunk_size '1092250' bulk_size: '8388608' offset: '0'
[20-03-25 15:47:46.072623] 159899 [I][main] rpc_srv_write() path: '/Alya.x' chunk_start '0' chunk_end '254' chunk_n '22' total_chunk_size '961180' bulk_size: '8388608' offset: '0'
[20-03-25 15:47:46.079077] 92840 [I][main] rpc_srv_write() path: '/Alya.x' chunk_start '0' chunk_end '254' chunk_n '29' total_chunk_size '1267010' bulk_size: '8388608' offset: '0'
[20-03-25 15:47:46.079590] 24538 [I][main] rpc_srv_write() path: '/Alya.x' chunk_start '0' chunk_end '254' chunk_n '23' total_chunk_size '1004870' bulk_size: '8388608' offset: '0'
[20-03-25 15:47:46.080318] 458315 [I][main] rpc_srv_write() path: '/Alya.x' chunk_start '0' chunk_end '254' chunk_n '26' total_chunk_size '1135940' bulk_size: '8388608' offset: '0'
[20-03-25 15:47:46.255840] 183290 [I][main] rpc_srv_write() path: '/alya-long.err' chunk_start '0' chunk_end '0' chunk_n '1' total_chunk_size '31741' bulk_size: '9897' offset: '0'
[20-03-25 15:47:46.261770] 183290 [E][main] rpc_srv_write() Failed to pull data from client. file /alya-long.err chunk 0 (startchunk 0; endchunk 18446744073709551615)